Use proper building flags
    
    Use the distribution building flags. Also remove the call to
    %set_build_flags: it's uncessary as it's called automatically before
    %build.
    
    Resolves: RHEL-33502
    
    Signed-off-by: Jerome Marchand <jmarchan@redhat.com>