the unconventional devices for the android video streaming
TRANSCRIPT
![Page 1: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/1.jpg)
THE UNCONVENTIONAL DEVICES FOR THE VIDEO STREAMING
IN ANDROID
![Page 2: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/2.jpg)
a.martellucci[at]reply.it
@martellux
+AlessandroMartellucci
m.bonifazi[at]reply.it
@mbonifazi
+MatteoBonifazi
Who We Are
![Page 3: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/3.jpg)
Who We Are our books
Sviluppare applicazioni per Android in 7 giorni
Android Programmazione Avanzata
Coming soon!
![Page 4: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/4.jpg)
• Reply is today a leading IT Services Company, which operates in Italy, Germany, UK,
Benelux, USA and Brazil.
• Open Reply is the company of Reply Group focused on open source software,
multichannel web solutions and mobile applications.
• Based in Rome, our team is based a young team of over 40 engineers 100% focused on
mobile development (iOS, Android & Windows Phone).
• We are specialised in broadcasting, banking and Android OS Customisation.
Open Reply
![Page 5: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/5.jpg)
Engage users through streaming app
*http://www.nielsen.com/us/en/insights/reports/2014/shifts-in-viewing-the-cross-platform-report-q2-2014.html
+53% +80%
+60%
-1% -1% -2%
18/34 35/49 50/64 Ages
![Page 6: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/6.jpg)
Engage users through streaming app
q In US more than 2 milion people watched last World Cup by a mobile App.1
q 270% increase in online video watched by smartphone and tablet.2
q More than one bilion tap on Google Chromecast cast button.3
q YouTube viewer habits prove “the bigger the screen, the longer people watch.”4
1)WatchESPN app access 2)Nielsen Q3 ‘14 Total Audience report 3) Google’s Omid Kordestani interview 2015 4) Youtube usage internal analysis.
![Page 7: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/7.jpg)
q Playing a video content on your handheld device.
q Streaming taiolered for the user with
q Easiest way to enjoy video and music on user TV with
Presentation Millestone
![Page 8: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/8.jpg)
Android multimedia framework
Android support for playing several media types from media file stored inside the application
(raw resources, standalone files) or for OTT streaming.
*Camera, foto rendering and other media type are managed by it but they are out of scope for this talk.
Network Protocols
RTSP (RTP, SDP)
HTTP/HTTPS progressive streaming
HTTP/HTTPS live streaming
Dynamic adaptive streaming over HTTP (DASH)
Smooth Streaming
Core Media Formats
H.263 ->3GPP(.3gp),MPEG-4(.mp4)
H.264 AVC -> 3GPP(.3gp),MPEG-4(.mp4),MPEG-TS(.ts)
MPEG-4 SP -> 3GPP(.3gp)
VP8 -> WebM(.webm),Matroska(.mkv) Note. Any given mobile device may provide support for additional formats or file types not listed in the table.
![Page 9: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/9.jpg)
Android multimedia framework documentation
50% Android multimedia framework questions are unaswered on Stackoverflow
![Page 10: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/10.jpg)
//1. Find the view from the layout VideoView myVideoView = (VideoView)findViewById(R.id.myvideoview); //2. Setup video url myVideoView.setVideoURI(Uri.parse(SrcPath)); //3. Setup Video controller myVideoView.setMediaController(new MediaController(this)); //4. Start playing myVideoView.requestFocus(); myVideoView.start();
VideoView.java
Media Playback 1/2
![Page 11: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/11.jpg)
//0. Get SurfaceView and its holder mPreview = (SurfaceView)findViewById(R.id.surfaceView); holder = mPreview.getHolder(); mp = new MediaPlayer(); //1. Create MediaPlayer object: //2. Add SurfaceHolder callback - Aware when SurfaceView is created holder.addCallback(new SurfaceHolder.Callback(){ .... @Override public void surfaceCreated(SurfaceHolder holder) { mp.setDisplay(holder); //3. Attach the surface to the player try { mp.setDataSource(filepath);
//4. Prepare the Mediaplayer in sync or async mode ( prepareAsync() ) mp.prepare(); } catch (Exception e) {// Catch the exception} mp.start(); //5. Start the player }... });
MediaPlayer.java
Media Playback 2/2
![Page 12: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/12.jpg)
ExoPlayer ExoPlayer is a media player built on top of the MediaExtractor and MediaCodec APIs released in Android 4.1 (API level 16). ExoPlayer provides default TrackRenderer implementations for audio and video, which make use of the MediaCodec and AudioTrack classes in the Android framework. During playback, your app can listen for events generated by the ExoPlayer that indicates the overall state of the player (ExoPlayer.Listener).
![Page 13: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/13.jpg)
player = ExoPlayer.Factory.newInstance(RENDERER_COUNT, minBuffer, maxBuffer); // 2. Construct renderers. DataSource dataSource = new UriDataSource(userAgent, bandwidthMeter); HlsChunkSource chunkSource = new HlsChunkSource(dataSource, url, manifest, bandwidthMeter, null,
HlsChunkSource.ADAPTIVE_MODE_SPLICE); HlsSampleSource sampleSource = new HlsSampleSource(chunkSource, true, 3); MediaCodecVideoTrackRenderer videoRenderer = new MediaCodecVideoTrackRenderer(sampleSource, MediaCodec.VIDEO_SCALING_MODE_SCALE_TO_FIT, 5000, player.getMainHandler(), player, 50); MediaCodecAudioTrackRenderer audioRenderer = new MediaCodecAudioTrackRenderer(sampleSource); player.prepare(videoRenderer, audioRenderer); // 3. Inject the renderers through prepare. player.setSurface(surfaceView.getHolder().getSurface()); // 4. Pass the surface to the video renderer. player.setPlayWhenReady(true); // 5. Start playback … … player.release(); // Release when everything is done!
ExoPlayer.java
ExoPlayer – HLS implementation
![Page 14: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/14.jpg)
What next? q Built-in players
ü AwesomePlayer (default player selected)
ü NuPlayer (Apple HLS)
q Extra player factories can be registered
q DIY mediaplayer ü Demuxing: android.media.mediaExtractor
ü Decoding: android.media.MediaCodec
ü Video rendering: android.media.MediaCodec
ü Audio rendering: android.media.AudioTrack
ü Implement the interfaceframeworks/av/include/media/MediaPlayerInterface.h
![Page 15: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/15.jpg)
Android TV
![Page 16: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/16.jpg)
Android TV is Android!!!
![Page 17: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/17.jpg)
Smartphone 5” 320 dp
TV Full HD 30” 320 dp
10 feet
16 inches
10 foot experience
![Page 18: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/18.jpg)
Keep calm and lean back!!
Provides built-in tailored for 10 feet experience
![Page 19: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/19.jpg)
<uses-feature android:name="android.software.leanback" android:required="true" /> <application android:allowBackup="false”
android:label="@string/app_name” android:theme="@style/Theme.Leanback" >
<activity android:name="MainActivity”
android:screenOrientation="landscape" > <intent-filter> <action android:name="android.intent.action.MAIN" /> <category
android:name="android.intent.category.LEANBACK_LAUNCHER" /> </intent-filter> </activity>
AndroidManifest.xml
Android Manifest features1/2
![Page 20: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/20.jpg)
Android Manifest features 2/2
Supporting landscape orientation is mandatory
No touch screen is required
<uses-feature android:name="android.hardware.sensor.accelerometer” android:required="false" />
<uses-feature android:name="android.hardware.touchscreen” android:required="false"/>
<activity android:name=”AndroidTvActivity” android:screenOrientation="landscape" >
Limit your sensor! Your app doesn’t need to accelerate!!!
![Page 21: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/21.jpg)
Leanback UI component – BroswerFragment
![Page 22: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/22.jpg)
Leanback UI component – DetailFragment
![Page 23: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/23.jpg)
Building Live TV Apps
TV Input Framework provides a unified method for receiving audio and video channel content from hardware sources and software sources.
Android 5.0 (API level 21) or higher
TV Provider manages all EPG info, meanwhile TV Input Manager handles streaming contents.
![Page 24: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/24.jpg)
TV Input Manager
<service android:name=”droidcon.it.DroidconTvInputService" android:label="@string/sample_tv_input_label" android:permission="android.permission.BIND_TV_INPUT"> <intent-filter> <action android:name="android.media.tv.TvInputService" /> </intent-filter> <meta-data android:name="android.media.tv.input" android:resource="@xml/sample_tv_input" /> </service>
onTune() event is fired when user selects a channel, and notifies the system TV app for changes in the content and meta data.
TvInputService creates a TvInputService.Session that implements Handler.Callback to handle player state changes.
![Page 25: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/25.jpg)
TV provider
<uses-permission android:name="com.android.providers.tv.permission.READ_EPG_DATA" /> <uses-permission android:name="com.android.providers.tv.permission.WRITE_EPG_DATA" />
Tv Channel
COLUMN_DESCRIPTION COLUMN_DISPLAY_NAME
COLUMN_DISPLAY_NUMBER COLUMN_INPUT_ID
COLUMN_SERVICE_TYPE COLUMN_TRANSPORT_STREAM_ID
COLUMN_TYPE
COLUMN_INTERNAL_PROVIDER_DATA COLUMN_NETWORK_AFFILIATION COLUMN_ORIGINAL_NETWORK_ID
COLUMN_SEARCHABLE COLUMN_SERVICE_ID
COLUMN_VERSION_NUMBER COLUMN_VIDEO_FORMAT
Tv Program
COLUMN_LONG_DESCRIPTION COLUMN_POSTER_ART_URI COLUMN_SEASON_NUMBER
COLUMN_SHORT_DESCRIPTION COLUMN_START_TIME_UTC_MILLIS
COLUMN_THUMBNAIL_URI COLUMN_TITLE
COLUMN_VERSION_NUMBER COLUMN_VIDEO_HEIGHT COLUMN_VIDEO_WIDTH
COLUMN_AUDIO_LANGUAGE COLUMN_BROADCAST_GENRE COLUMN_CANONICAL_GENRE
COLUMN_CHANNEL_ID COLUMN_CONTENT_RATING
COLUMN_END_TIME_UTC_MILLIS COLUMN_EPISODE_NUMBER
COLUMN_EPISODE_TITLE COLUMN_INTERNAL_PROVIDER_DATA
A basic database of TV content metadata such as channel and program information.
Manifest permission:
![Page 26: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/26.jpg)
Chromecast a cast-ready device for multi-screen experience
source: www.google.it
![Page 27: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/27.jpg)
Chromecast some numbers
• 10 million units sold • 1 billion times for Cast button • 300+ apps on Play Store • 6000 developers on 10000 apps
![Page 28: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/28.jpg)
Chromecast components
• Google Cast technology
• Multi-Screen experiece • Google Cast SDK
• Sender Application • Android app • iOS app • Chrome app
• Receiver Application • Default Media Receiver • Styled Media Receiver • Custom Media Receiver
![Page 29: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/29.jpg)
Android Client Application library dependencies
• Minimum SDK version supported by Google Cast is 9 (Gingerbread) • MediaRouter API of android-support-v7 • Google Play Services • AppCompat API of android-support-v7
![Page 30: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/30.jpg)
Android Client Application typical sender application flow
• Sender app starts MediaRouter device discovery: MediaRouter.addCallback • MediaRouter informs sender app of the route the user selected: MediaRouter.Callback.onRouteSelected • Sender app retrieves CastDevice instance: CastDevice.getFromBundle • Sender app creates and uses GoogleApiClient: GoogleApiClient.Builder
• Sender app launches the receiver app: Cast.CastApi.launchApplication • Sender app creates a communication channel: Cast.CastApi.setMessageReceivedCallbacks • Sender sends a message to the receiver over the communication channel: Cast.CastApi.sendMessage
source: developers.google.com
![Page 31: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/31.jpg)
Cast-Ready Device Discovery capabilities
Remote Playback Live Audio Live Video
MediaRouteSelector.Builder builder = new MediaRouteSelector.Builder(); builder.addControlCategory(MediaControlIntent.CATEGORY_REMOTE_PLAYBACK); builder.addControlCategory(MediaControlIntent.CATEGORY_LIVE_AUDIO); builder.addControlCategory(MediaControlIntent.CATEGORY_LIVE_VIDEO); MediaRouterSelector selector = builder.build();
MainAc'vity.java
![Page 32: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/32.jpg)
Media Cast Button easy approach for discovering
source: developers.google.com source: developers.google.com
public boolean onCreateOptionsMenu(Menu menu) { MenuItem mediaRouteMenuItem = menu.findItem(R.id.media_route_menu_item); MediaRouteActionProvider mediaRouteActionProvider = (MediaRouteActionProvider) MenuItemCompat.getActionProvider(mediaRouteMenuItem); mediaRouteActionProvider.setRouteSelector(mMediaRouteSelector); }
MainAc'vity.java
![Page 33: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/33.jpg)
RemoteMediaPlayer …finally
MediaInfo mediaInfo = new MediaInfo.Builder("http://your.server.com/video.mp4") .setContentType("video/mp4") .setStreamType(MediaInfo.STREAM_TYPE_BUFFERED) .setMetadata(mediaMetadata) .build();
… mRemoteMediaPlayer = new RemoteMediaPlayer(); mRemoteMediaPlayer.load(mApiClient, mediaInfo, true); …
MainAc'vity.java
![Page 34: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/34.jpg)
Receiver Application powered by Chrome
What is?
HTML5 and Javascript application
What does? Display the media content on TV
Message handling
Which type?
Default Media Receiver
Styled Media Receiver Custom Media Receiver
source: unknow
![Page 35: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/35.jpg)
Default Media Receiver simplest
• Off-the-shelf
• No UI customization
• No registration
Source: developers.google.com
![Page 36: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/36.jpg)
Styled Media Receiver simple and customizable
• Similar to Default Media Player
• CSS UI customization
• Registration
Source: developers.google.com
![Page 37: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/37.jpg)
Custom Media Receiver whatever you want
• Fully Web Applicaiton
• Debug(able) at 9222
• Registration
Source: developers.google.com
![Page 38: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/38.jpg)
Custom Media Receiver basic example
<html> <head> <title>Example minimum receiver</title> <script src="//www.gstatic.com/cast/sdk/libs/receiver/2.0.0/cast_receiver.js"></script> </head> <body> <video id='media'/> <script> window.mediaElement = document.getElementById('media'); window.mediaManager = new cast.receiver.MediaManager(window.mediaElement); window.castReceiverManager = cast.receiver.CastReceiverManager.getInstance(); window.castReceiverManager.start(); </script> </body> </html>
Index.htm
![Page 39: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/39.jpg)
Custom Media Receiver advanced features
• Video Codification/Decodification • H.264 High Profile Level 4.1, 4.2 and 5 • VP8
• Adaptive Bitrate Streaming
• HTTP Live Streaming (HLS) • Dynamic Adaptive Streaming over HTTP (MPEG-DASH) • Smooth Streaming
• Digital Rights Management • Play Ready DRM • Widevine DRM
• Media Player Library
![Page 40: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/40.jpg)
Custom Media Receiver advanced example
Index.htm
<html> <head> <script src="//www.gstatic.com/cast/sdk/libs/mediaplayer/1.0.0/media_player.js" /> </head> <body> <script type="text/javascript"> window.defaultOnLoad = mediaManager.onLoad; mediaManager.onLoad = function (event) { if (window.player !== null) { player.unload(); window.player = null; }
![Page 41: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/41.jpg)
Custom Media Receiver advanced example
if (event.data['media'] && event.data['media']['contentId']) { var url = event.data['media']['contentId']; window.host = new cast.player.api.Host({'mediaElement':mediaElement, 'url':url}); var ext = url.substring(url.lastIndexOf('.'), url.length); var startAt = event.data['media']['currentTime'] || 0; var autoplay = event.data['autoplay'] || true; var protocol = null; mediaElement.autoplay = autoplay; if (url.lastIndexOf('.m3u8') >= 0) { protocol = cast.player.api.CreateHlsStreamingProtocol(host); } else if (url.lastIndexOf('.mpd') >= 0) { protocol = cast.player.api.CreateDashStreamingProtocol(host); } else if (url.indexOf('.ism/') >= 0) { protocol = cast.player.api.CreateSmoothStreamingProtocol(host); }
Index.htm
![Page 42: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/42.jpg)
Custom Media Receiver advanced example
host.onError = function(errorCode) { if (window.player) { window.player.unload(); window.player = null; } }; if (protocol !== null) { window.player = new cast.player.api.Player(host); window.player.load(protocol, startAt); } else { window.defaultOnLoad(event); } } } window.player = null; window.castReceiverManager = cast.receiver.CastReceiverManager.getInstance(); castReceiverManager.start();
Index.html
![Page 43: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/43.jpg)
Resources
• Google Cast: https://developers.google.com/cast • Chromecast App: http://www.google.it/chrome/devices/chromecast/apps.html • Google Cast Downloads: https://developers.google.com/cast/docs/downloads • Github: https://github.com/googlecast
• Android TV: https://developer.android.com/tv • Android TV Apps: http://www.google.it/chrome/devices/chromecast/apps.html • Android TV codelab: g.co/dev/codelab-androidtv • Github Leanback: https://github.com/googlesamples/androidtv-Leanback.git
![Page 44: The unconventional devices for the Android video streaming](https://reader034.vdocuments.us/reader034/viewer/2022042607/55b0308a1a28ab5a268b45b0/html5/thumbnails/44.jpg)
Enjoy the video thank you to all of you
Source: www.huffingtonpost.ca
+MatteoBonifazi +AlessandroMartellucci @mbonifazi @martellux