No, he said he was never poor, but have been broke before. That is a mindset too. Meaning he at certain points had no money, but he never allowed that to cause him to make decisions out of a mentality of being poor.He said he wasnt rich but he also said he wasn't poor.
reminds me of when Trump said he got started in real estate with just a small loan from his dad. (1 million dollars)
People like that have different metrics of rich and poor. By "not rich" he probably meant his parents were only single digit millionaires, not multi millionaires.
Edit: I have also been broke before, but I have never been poor. I continued to make decisions understanding how to make money, even when at the time I had no money.