Signs include extensive decay, severe insect infestation, major structural defects, root damage, dead limbs throughout the canopy, significant leaning, and visible trunk cavities. An arborist can assess whether removal is necessary.