this post was submitted on 10 Jun 2023
25 points (100.0% liked)

Technology

37717 readers
465 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] eddythompson@beehaw.org 0 points 1 year ago (2 children)

That explanation is the most amount of nonsense I’ve read in a long time. The amount of mental gymnastics you need to non-ironically believe that is just unbelievable

[–] alyaza@beehaw.org 12 points 1 year ago* (last edited 1 year ago) (1 children)

i'd appreciate it if, for outsiders, you could explain why it's "the most amount of nonsense" and "mental gymnastics" in actual detail instead of just saying that. as is, this is a very unproductive comment.

[–] eddythompson@beehaw.org 5 points 1 year ago* (last edited 1 year ago) (1 children)

Because of course Invidious calls YouTube APIs. They call the internal APIs the same way YouTube official client calls the API. They even have the API Key of one of YouTube client's in their repo. The guy's argument is that since they reverse engineered the calls, which is fine, they don't have to agree to YouTube's TOS to call it, which means YouTube's cease and desist invalid. I host my own private instance of Invidious to stream youtube audio to my phone. Of course reverse engineering is fine, scarping is fine, even the code is fine, and I'd agree that YouTube going after repos on github is wrong. But of course hosting Invidious is a violation of YouTube's TOS.

[–] AbelianGrape@beehaw.org 4 points 1 year ago* (last edited 1 year ago) (2 children)

I'll admit I hadn't seen that, and that I was just echoing what TheFrenchGhosty said. That sure does look like official API access. They also seem to make calls through that wrapper to access comments and plenty of other things, so it's not just sitting there unused.

Thankfully, TheFrenchGhosty is on the Fediverse, so let's ask them: @TheFrenchGhosty@lemmy.pussthecat.org @TheFrenchGhosty@libretooth.gr (not sure which one of these to use) How is this not using an official YouTube API?

The README and the refute of YouTube's C&D letter both claim that Invidious doesn't use YouTube's APIs at all - not merely that the response creation/interpretation was reverse-engineered. Obviously, the TOS applies to the fact that you interact with the API, not whether you access it manually or with the help of some code pre-prepared by Google. Yet it seems that other people have vetted you and not raised this issue. So I'm assuming we're simply misunderstanding here, and hoping you can clear it up.

[–] TheFrenchGhosty@lemmy.pussthecat.org 6 points 1 year ago* (last edited 1 year ago) (1 children)

Hello,

The thing is that the agreement they linked apply to the official YouTube API (the one that you have to register for).

Invidious uses the InnerTube (a completely different "API" used by all official YouTube clients). Invidious basically acts like a web browser that access the YouTube website. It is therefore not required to agree to any TOS/policies.

All those findings where done via clean room reverse engineering (which is legal in the EU).

[–] AbelianGrape@beehaw.org 2 points 1 year ago* (last edited 1 year ago) (1 children)

That makes Invidious' readme (which claims no YouTube APIs at all) disingenuous at the very least.

More likely, you need a lawyer. I read that TOS, and I think it applies to any YouTube API endpoint, internal or otherwise. Best of luck, because I agree with Invidious' goals...

Side note: a browser communicating with YouTube would be communicating with youtube. Not with com.google.android.youtube.api or whatever. What I'm seeing is that Invidious tries to act like the youtube service itself, which is very different from acting like a browser.

Edit: I've spent about 5 minutes looking for EU case law about this but haven't been able to find anything except un-cited references to an exception for "producing interoperable devices." Do you have sources? In the United States, at least, "clean room reverse engineering" has a pretty specific definition that follows four steps:

  1. A (team of) engineers reverse-engineers an existing product, in this case, the YouTube internal API.
  2. Those engineers write a specification of the product's (outwardly-visible) behavior.
  3. A lawyer reviews that specification to ensure that it does not contain anything infringing on any copyrights relevant to the product.
  4. A separate (team of) engineers re-implement the product according to the specification.

I don't think what you're doing meets that definition. You achieved step 1, and possibly step 2, and then didn't attempt the others. You reverse engineered something for the purpose of using it - but you haven't actually reimplemented it, which is the "clean room" part of "clean room reverse engineering." Re-implementing it would presumably require building your own server for actually hosting videos on Invidious instances.

There's quite a history of this term in the US, going back to even before Intel vs. NEC, when it was very much in the public eye. As part of arguing that case, NEC, following this procedure, produced a clean-room re-implementation of Intel's popular 8008 microprocessor's microcode. To do that, they had to re-write all of the microcode from scratch. Not figure out how to inject the 8008's microcode into their own hardware design.

Anyway, all that aside, even if what you're doing did meet the conditions of clean-room reverse engineering, I don't think it would fall under the (again, un-cited, so maybe we're talking about different things) interoperability exception in the EU. You're not producing a device/service that needs to be interoperable with other devices/services. You're producing a service with an explicit goal of operating differently.

To be clear, IANAL, but your reasoning seems shaky.

[–] TheFrenchGhosty@lemmy.pussthecat.org 1 points 1 year ago (1 children)

That makes Invidious' readme (which claims no YouTube APIs at all) disingenuous at the very least.

The InnerTube isn't the YouTube API, far from it. So it's still valid.

[–] AbelianGrape@beehaw.org 1 points 1 year ago* (last edited 1 year ago) (1 children)

"Valid" and "disingenuous" mean very different things. How would you feel about editing that README point to be explicit that you use an ~~unofficial~~ undocumented YouTube API?

For the record, I don't think "InnerTube" would be considered unofficial, legally. It's authorized by YouTube, since they made and use it internally. That's the definition of "official." This is a small part of why I think the wording in the TOS makes the TOS apply to "InnerTube." What makes you think that it doesn't?

What makes you think that it doesn't?

The fact that it isn't "the YouTube API". The policy only applies to the API you can get "officially".

[–] eddythompson@beehaw.org 2 points 1 year ago* (last edited 1 year ago) (2 children)

well, there was a long thread about this on /r/selfhosted where @TheFrenchGhosty@lemmy.pussthecat.org @TheFrenchGhosty@libretooth.gr was saying pretty much what I said, but with a tad more mental gymnastics mostly about EU laws regarding reverse engineering and lack of a formal agreement between them and YouTube.

Unfortunately (or fortunately?), /r/selfhosted is private atm due to the blackout, so I'm unable to find and share thread link.

The facts are:

  • Invidious (as an OSS project) calls undocumented internal YouTube APIs (they call it InnerTube).
  • Anyone can host an Invidious instance.
  • The main Invidious instance, i.e: https://invidious.io/ received a cease and desist from YouTube.

@TheFrenchGhosty@lemmy.pussthecat.org @TheFrenchGhosty@libretooth.gr posted all about this on GitHub, reddit, their personal blog, and contacted random media outlets like the one linked here, to complain about how "we have nothing to do with YouTube, why is YouTube bullying us". And since everyone obviously wants to give the little guy the benefit of the doubt, everyone starts wondering how it could be that a project that's all about providing an alternative UI for YouTube, doesn't call YouTube.

It's like if a movie pirating website is trying to argue

"Endgame.mp4" is just a file name. It has nothing to do with Marvel or Disney. What the hell are those greedy companies have to do with us??

I'm all for invidious, piracy, etc. But seriously?

[–] pokexpert30@lemmy.pussthecat.org 3 points 1 year ago (1 children)

Gday matey. The difference with Invidious and endgame.mp4, is that invidious doesnt host anything, its merely a proxy.

[–] eddythompson@beehaw.org 0 points 1 year ago (1 children)

A torrent tracker doesn't host anything either. It's merely a lighthouse for people to know who is hosting it. And trackers are hosted exclusively in certain specific countries because of that.

[–] pokexpert30@lemmy.pussthecat.org 0 points 1 year ago (1 children)

I think the issues with trackers is they were making money out of it? Iirc the trackers themselves, if kept from making a profit are untouchable

[–] eddythompson@beehaw.org 1 points 1 year ago

I'm not sure that's true. Most private trackers accept donations. Some even require you to buy some seedbox plan they get commission from (even though that's generally frowned upon).

All the high profile trackers I can think of that were shutdown through legal notice (Mininova, isoHunt, KickassTorrent, ThePirateBay, etc) were all public trackers. Maybe they had ads or something on their website, but their shutdown had nothing to do with them making money. They were shutdown for piracy even though they never "hosted" any content. They were just trackers.

Hell, even Popcorn Time, a software that just let you easily search torrents and stream them, it hosted nothing, just connected you to trackers that had movies was too shutdown by legal notice.

Trackers that survive are usually hosted behind VPNs and are physically located in Russia or China.

[–] AbelianGrape@beehaw.org 2 points 1 year ago* (last edited 1 year ago)

It's certainly possible to scrape data from interactions with a site directly, without using its API. This is even legal - there were no gymnastics in my response there. However, that decision has since been remanded, then re-affirmed, then challenged, and then LinkedIn obtained an injuction against HiQ which the two of them are still fighting over. So it could get properly overturned.

I definitely thought it seemed like it would be difficult to do this to offer a youtube frontend, but plausible enough that I didn't look into it. Thank you for this. I'm looking more closely now :)

If they are using undocumented internal APIs, do YouTube's API TOS apply to those? I checked the text of the TOS and it seems to me like it should apply; they say "The YouTube API services ... made available by YouTube including ...". That seems broad enough to me to cover internal APIs as well, if their endpoints are accessible, but IANAL.

Also, the open response to the C&D seems to throw shade at the TOS saying "The "YouTube API Services" means (i) the YouTube API services" but ignores that this is immediately followed by parenthetical examples and qualifiers. The TOS is defining the term so that it doesn't have to repeatedly add the qualifiers. Nothing weird about that. That's uh... pretty bad-faith arguing, if I'm interpreting it correctly.

Edit: assuming you refer to the same reverse engineering points that they made above... yeah.

[–] lemann@lemmy.one 2 points 1 year ago (1 children)

You can't say something that profound and leave us on a cliffhanger... Ellaborate a bit please?

[–] AbelianGrape@beehaw.org 3 points 1 year ago (2 children)

They've (convincingly) followed up above. I'm hoping the contributors to Invidious can clear this up. If no one replies here, I'll open an issue on Invidious' GitHub page asking that clarification be added to the readme on how their YoutubeAPI wrapper is not using an official YouTube API.

[–] vandrw@mander.xyz 2 points 1 year ago

One of the devs answered above

[–] lemann@lemmy.one 1 points 1 year ago

Ooh thanks for the reply, I wouldn’t have known otherwise!