The way I think of this is that に is marking a "target", so when you say "it's at the house" or "he's in the village", even within English sentences both "house" and "village" can be thought of as targets in that case. Tis a new way of thinking really. While if you say "I study at my house", house in that case isn't are a target, but more so extra information to the statement. I like to think of で as though what it marks is used to achieve the statement. So the statement "I study" is achieved by "being at my house".

Please remember that English and Japanese are different from each other so you can't think about Japanese language with the English rules. The same happens to us when we use English. It's better to remember them with the whole sentence like うちでテレビをみます / こうえんにいます / こうえんであそびます / としょかんでほんをよみます。I couldn't explain well for my English. I hope other people explain it to you more.