Skip to content
This repository has been archived by the owner on Aug 21, 2024. It is now read-only.

Update Shaka Player to get CC support #232

Open
Rastrelli1 opened this issue Mar 18, 2022 · 5 comments
Open

Update Shaka Player to get CC support #232

Rastrelli1 opened this issue Mar 18, 2022 · 5 comments
Labels
type: enhancement New feature or request
Milestone

Comments

@Rastrelli1
Copy link

Platform: iOS
We add to manifest CC information
<Accessibility schemeIdUri="urn:scte:dash:cc:cea-608:2015" value="CC1=eng"/>

Parsing worked
[Log]: "DashParser.parseAdaptationSet" [Log]: "DashParser.parseAdaptationSet closedCaption urn:scte:dash:cc:cea-608:2015 value CC1=eng" [Log]: "DashParser.parseAdaptationSet closedCaption parsed language eng"

but don't add CC on update media because window.muxjs: undefined
[Log]: "MediaSourceEngine.prototype.appendBuffer video time: 1647586338.4780111 1647586343.4780111 hasClosedCaptions: true" [Log]: "MediaSourceEngine hasClosedCaptions true window.muxjs: undefined" [Debug]: "(video:6)" "finished fetch and append"

neither the old method Player.usingEmbeddedTextTrack() Player.selectEmbeddedTextTrack() nor the added to getTextTracks() but it doesn't tell the embedded wrapper that there are closeCaptions

What we can dot it for show CC?

@joeyparrish
Copy link
Member

This may require an update to the embedded version of Shaka Player. We have built-in CC parsing now, whereas earlier versions of Shaka Player required an additional library called mux.js for CC parsing.

@joeyparrish joeyparrish added the type: enhancement New feature or request label Mar 18, 2022
@joeyparrish joeyparrish changed the title Don't show internal ClosedCaptions Mar 18, 2022
@github-actions github-actions bot added this to the Backlog milestone Mar 18, 2022
@Rastrelli1
Copy link
Author

Yes, I see patch with replace muxjs to CC608 decoding on v3.0 of shaka player, but decided to copy shaka-player/node_modules/mux.js/dist/mux.js (v2.5.14) into framework, and loaded after player
  JsManagerImpl* manager = JsManagerImpl::Instance();   CHECK(RunScript(manager->GetPathForStaticFile("shaka-player.compiled.js")));   CHECK(RunScript(manager->GetPathForStaticFile("mux.js")));

and this work, showed CC as expected. Thanks, I will closed this issue)

@joeyparrish
Copy link
Member

Thank you for the update, but I would like to reopen it until we have updated the embedded build of Shaka Player.

@joeyparrish joeyparrish reopened this Mar 21, 2022
@Rastrelli1
Copy link
Author

Thanks, if this needed of course let's update player
We have the same problem with TTML subtitles in #225, @joeyparrish can you answer on description questions, where we need integrate showing subtitles with images, on shaka layer, or on embedded wrapper?

@joeyparrish
Copy link
Member

In Shaka Player on the web, image-based subtitles are displayed through the DOM, which is driven by a TextDisplayer plugin (UITextDisplayer). In Embedded, I believe there would have to be a TextDisplayer plugin that is implemented in C++ to pipe the data up to where it can be displayed. Nobody at Google has had time to work on that.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
type: enhancement New feature or request
2 participants