I recently started up FreshRSS in my docker environment. I was super excited about the web scraping feature.

Now that I’m setting it up, it looks like that it is able to scrape single web pages, but I am unable to figure out how to get it to crawl into the actual article to scrape the full content.

Is anyone aware of how to do this. For example, runescape.com/m=news/ This page has a list of articles with a thumbnail, title, category, date, and a short description of the article. Would it be possible for FreshRSS to crawl into the article link and scrape the contents within?

  • EliteCow@lemmy.dbzer0.comOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    1 year ago

    Thank you so much! This worked out fantastically and it also looks great in the feed. I don’t know how you figured this stuff out but I need to get learned up on this!