Use Blender version 2.9 for a broken wall effect based on the Cell Fracture add-on. There are techniques in the video: "Copy from Active" in Rigidbody, Make links Animation Data to assign primary key ...

Requires Blender version 2.9 or later.