How to use when = Destroy?

I am trying to run a script when a module gets removed from a project. The workflow that I use is we remove the reference to the module in the tf file to do the destroy. This causes the script not to kick off, if I run terraform destroy then it works. Is there any other method to get this to work?