Fix potential issue when installing from GH

A leftover package tree might be in the cache directory,
and then a later install picks that up instead of the
binary package file from the cache.