Yes, ideas affect the material world, in fact they are the main driver of what happens in the material world. 

Your attachment to your ideas (and effort to preserve them) is 100% materialistic. 

It's not an objectively bad thing to have some level of materialism.