I was the only person who was invited是不是who 和that 都可以?看见the

I was the only person who was invited是不是who 和that 都可以?看见the only只能用that是对先行词是物
问题1书上有一句.I was the only person who was invited,又有一句He was the only person that I want to talk to.是不是who 和that 都可以?看见the only,the very等等,只能用that而不用which是对于先行词是物来说的,那么人的话是不是who或that都可以呢?
那么如果先行词是时间 地点是不是也要遵守上面的呢?
既然IHe was the only person that was invited .中that是宾语那么在有像有the only the very 这种特例的情况下能省略吗?