[bredren]

I am very interested in this, and I have personally built manual workflows to do Youtube video -> rip audio->transcript->llm context.

For example, taking a video about building garden retaining walls and generating detailed system prompts for Q&A with the expert in the video.

I reference ~home improvement or tool videos and often comments contain points of wisdom or even corrections of mistakes (errata) on videos that are otherwise good. For example, setting up a hand plane and ways to mark a board you're working on.

Do you use video comments in your context? I've (manually) scraped content on educational videos and built prompting to assess signal and incorporate what are likely important errata in LLM context.

> video/resource —> transcript/text —>

For this step in your pipeline, are you multi-modal? I mean, are you using the LLM to interpret what is shown in the video itself? How is that content used?

Do you have any sense for allowing people to generate educational content off arbitrary videos?

[bestwillcui]

For now we only use the YouTube transcript because for most educational content we've found it does about as well for lower cost.

We may make that an option though, since we also offer other resource types (pdf, slides, docs) -> course.

[bredren]

How about comments? Have you tested refining comment threads for useful errata or adding key details?

This maybe doesn't matter as much in the content you're processing now, but see my reply to sibling comment here, where it matters a lot for these niche videos where the creator did not mention or did not know about some important detail of a process or task.

[tdthree]

To your last question, what do you mean by arbitrary? If the video is not educational at all, then the generated course will likely not be good. If the video is pure entertainment then probably not a good use case.

[bredren]

I did not mean completely arbitrary. I meant:

If I have personally qualified a person as an expert on building retaining walls for landscaping and want to have your platform process a particular video, would you allow this?

I'm not necessarily interested in the topics you're providing resources around. I want niche topics. Like roofing or how to properly set up a traditional hand planer.

I am interested in individual, often amateur contributors of niche knowledge on youtube, not channels designed to educate in the first place.