A carpet knife can work well for cutting away old caulking from house siding. Slice down alongside it from both directions with the hook-like blade, then use the knife to lift out the old caulk bead intact.