If it's only small, it depends on where it is being targeted, as just a small part of a building won't draw attention, and usually the spot will reform - it depends on what your idea of small is.

But in Loki's case re: the core lights, he will have attention drawn to him in terms of the D-Force knowing where he is, and as well as nearby civilians.

Also, a large amount being destroyed at once will draw attention, yes.