Here’s the logic:
wget --mirror --convert-links --adjust-extension --page-requisites --no-parent https://example.com/

  • Fifrok@discuss.tchncs.de
    link
    fedilink
    arrow-up
    9
    ·
    edit-2
    1 day ago

    Hey, just so you know this is legally iffy.

    PieFed.social is hosted in the EU, and this amount of scraping can fall under the Copyright Directive 2001/29/EC and the Database Directive 96/9/EC.

    Even if the content is public, EU law can restrict bulk extraction and republication. Especially if you’re mirroring a substantial part of the site or making it available through your own frontend.

    Might be worth reconsidering what you’re pulling and how you’re using it, or atleast making sure it’s legal.

    edit: I’m obviously not a lawer, this might have no problems related to that, but I would make sure if I were you.

      • Fifrok@discuss.tchncs.de
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        16 hours ago

        So, good news: Since you apparently aren’t scraping the content, only the UI, my first comment is irrelevant. And this probably doesn’t break AGPL.

        Bad news: If I’m understanding you correctly you are copying and re-serving someone else’s page design and layout, which might fall under reproduction of copyrighted material and may be an even bigger issue than what I said in my first comment. Especially since your Terms of Service appears to claim ownership of the design.

        If I were you, I would really make sure you aren’t breaking law with this. Seems like something that could come back to bite you very easily.