this post was submitted on 16 Dec 2024
124 points (96.3% liked)

Open Source

31822 readers
525 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
Cloak@lemmy.ml
kevincox@lemmy.ml
CrypticCoffee@lemmy.ml
Lettuceeatlettuce@lemmy.ml
124
Microsoft open-sourced a Python tool for converting files and office documents to Markdown (github.com)
submitted 2 weeks ago by yogthos@lemmy.ml to c/opensource@lemmy.ml
23 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] django@discuss.tchncs.de 3 points 2 weeks ago (1 children)

I like libreoffice, but converting audio files to markdown must be a pretty recent feature, for I never heard of it before being part of libreoffice.

[–] utopiah@lemmy.ml 2 points 2 weeks ago (1 children)

converting audio files to markdown must be a pretty recent feature

Quite curious... does it actually do that and if so how? Because STT to get a plaintext file or subtitle (so with timing) has been available via e.g. Whisper quite efficiently for a while now. If this though does do more, e.g. structure (differentiating a title, list, etc) I'd like to learn how.

[–] django@discuss.tchncs.de 3 points 2 weeks ago (1 children)

There is nothing special going on. This whole project is just a bunch of python libraries coupled together to a cli tool. It uses the package SpeechRecognition to connect to the google speech recognition api: https://github.com/microsoft/markitdown/blob/main/src/markitdown/_markitdown.py#L691

Pretty uninteresting and a bit disappointing. Pandoc is a lot more interesting.

[–] utopiah@lemmy.ml 1 points 2 weeks ago (1 children)

Thanks for the clarification. I checked the code you linked and noticed recognize_google and seems it's relying on https://github.com/Uberi/speech_recognition which then seems to rely on https://github.com/Uberi/speech_recognition/blob/master/speech_recognition/recognizers/google.py so basically are they using an API, sending all the audio data to Google servers?

[–] django@discuss.tchncs.de 1 points 2 weeks ago (1 children)

Yes, this is how I read it as well. The library would support to use a local model, but they decided to just send the audio data to Google.

[–] utopiah@lemmy.ml 3 points 2 weeks ago

Might open up a GDPR related issue there. I don't think people using such a library assume they need connectivity nor that their data would be send to a 3rd party.