It seems odd that the items should still be on the chart as you eliminate the indior it deletes all of its items.
The fast fix is just to go into the object list and delete the relevent items. It should be obvious which ones they are and as a sign you can multi-select objects together with the conventional windows method of the shift or ctrl keys and then click delete.
As a permanent fix, edit your template files and eliminate all the object entries. This way when you use the template to a new chart, the correct items...