Add EFA MD and update memory registration access flags

[SeyedMir]

What

This PR adds a new MD to support EFA devices.

Why ?

Justification for the PR. If there is existing issue/bug please reference. For bug fixes why and what can be merged in a single item.

How ?

It is optional but for complex PRs please provide information about the design, architecture, approach, etc.

[swx-jenkins3]

Can one of the admins verify this patch?

[brminich]

ok to test

[SeyedMir]

@yosefe just wondering if you had a chance to review the changes that I made. Thanks!

[yosefe]

relevant fail:

error: Installed (but unpackaged) file(s) found:
   /usr/lib/debug/usr/lib64/ucx/libuct_ib_efa.so.0.0.0-1.12.0-1.fc34.x86_64.debug
   /usr/lib64/ucx/libuct_ib_efa.so.0
   /usr/lib64/ucx/libuct_ib_efa.so.0.0.0
    Installed (but unpackaged) file(s) found:
   /usr/lib/debug/usr/lib64/ucx/libuct_ib_efa.so.0.0.0-1.12.0-1.fc34.x86_64.debug
   /usr/lib64/ucx/libuct_ib_efa.so.0
   /usr/lib64/ucx/libuct_ib_efa.so.0.0.0