To silo something off is to categorize it separately/away from other things. You'll hear "silo" used a lot in business when talking about organization structures, although the word itself refers to something used to store grain. A "siloed" organization is one in which departments operate independently of each other without communicating.
Equity refers to something's value or worth (and is usually used in the context of stocks/trading). Sweat equity is value you've built with hard work. For example, "John has a lot of sweat equity invested in his new small business."
And then "all the equity I have" means all of that value came from sweat equity. It didn't come from luck, business connections, etc.
This phrase is a bit awkward because of these expressions- I don't think most people would speak like this. However, he or she is basically saying "I stopped listening to people who tied to categorize me as a certain type of actor. As a producer, I put a lot of time and effort into a production- that's everything I can give."