User blog comment:DaNASCAT/Technical Update: May 6, 2015/@comment-24409505-20150509101641/@comment-24473195-20150509104708

See CacheCheck, it should do what you need. It should also be pretty easy to mod it so that it hides the pages that have been solved rather than simply crossing them out.

Note: This script is meant for personal use not sitewide.