not really, there is no way in Minecraft to know if a block was placed by a player or not.
That's why dirt have no vanilla loot in the game.
What you can do is add the loot configuration to STONE or similar block which cannot be easily broken and placed fast.