There has been speculation since the star told a concert crowd he would have voted for Mr Trump - if he had voted - and then turned up at Trump Tower.
But Tom Barrack, the Presidential Inaugural Committee chair, told CNN the ceremony is "not the venue" for West.