To give accurate updates from the political landscape, the Newsdirect Wales team crawled Welsh Gov, Senedd, and party websites constantly, looking for new stories and blogs. The entire process was tedious and manual, and it was hard to actively report on client mentions.
Have a similar challenge? Get a 60-second quote
The first step was to get a real strong idea of how the team worked, and analyse what parts of the process could be automated. Then we got to building the first version of Scrapey, a bot that monitors and scrapes websites 5 times a day for new content, compiling the new stuff into an accessible format for the team. Now, the team had the latest content delivered right to them, exactly when they needed it. Zing!