Deleting files doesn't remove them. Encryption before deletion makes recovery impossible.
Use secure delete tools.