Not being able to break a tile can be confusing
It can be unclear and surprising when you can't break something. The cursor should give some kind of feedback before you try breaking that the tile can't fit in your inventory or breaking the tile needs a specific tool. This could be accomplished by changing the color of the cursor.
Ideally, there would be a differentiation between the different reasons to make it immediately clear what the problem is.