sounds in bada

Sounds in bada

Contents

Introduction

Common Sound Classes– AudioRecorder/Player– AudioIn/AudioOut

Simple Mixing

Media Management– Image– Video– Streaming

Summary2

*This material is based on bada SDK 1.0.0b3

Media Introduction

Audio/ video/ image processing functions

Key features

• Playback• Record• Streaming• PCM processing

• Playback• Record• Streaming• Camera capture• Camera preview

• Load• Save• Format conversion

Supported FormatsType Format Encode Decode Streaming*Video H.263, MPEG-4 (.3gp, mp4) O O O

H.264 (.3gp, mp4) O OVC-1 (.wmv, .asf) O

Audio PCM (.wav) O OAMR-NB (.amr, .3ga, .m4a) O O OAAC, AAC+, EAAC+ (.aac, .3ga, .m4a)

MIDI (.mid, .spm, .imy, .mmf, .xmf) OMP3 (.mp3), WMA ( .wma, .asf) O

Image JPEG, PNG, BMP O OGIF, TIFF, WBMP O

*Streaming Protocol: RTSP4

Header & Library

Header file: – #include <FMedia.h>

Library – Simulator: FMedia – Target: FOsp

Privilege groups– RECORDING– IMAGE– CAMERA

Common Sound Classes

Basic method:General purpose

Complex method:Direct access to device

Audio Recorder & Player

*PCM: Pulse Code Modulation 7

Recording– AudioRecorder : Records

audio data from input source to storage

Playing– Player : Open audio file

and play

Recording– AudioIn : Read raw PCM

data from input srouce

Playing– AudioOut : Play sound with

raw PCM data

Playback– Player– AudioOut

Basic method

AudioRecorder class

Records audio data from input source to storage– Recording format

• WAV, AMR

Event– IAudioRecorderEventListener

• OnAudioRecorderPaused• OnAudioRecorderStarted• OnAudioRecorderStopped• OnAudioRecorderClosed• OnAudioRecorderCanceled• …

"RECORDING" privilege is needed10

Using the AudioRecorder class

Create AudioRecorder instance

Recording

Stop recording & close

__pAR = new AudioRecorder;__pAR->Construct(*pListener);

// IAudioRecorderEventListener

__pAR->CreateAudioFile( __path, true);__pAR->SetFormat(AUDIORECORDING_FORMAT_WAVE);__pAR->Record();

__pAR->Stop();…void EventListener::OnAudioRecorderStopped( result r){

__pAR->Close();}

Player class

Can play audio & video– Multiple audio playback is supported(max 10)

• Only 1 compressed audio files– Can play audio/video by streaming

• Streaming Protocol: Real-Time Streaming Protocol (RTSP)

Event– IPlayerEventListener

• OnPlayerBuffering, OnPlayerInterrupted• OnPlayerEndOfClip, OnPlayerErrorOccurred• OnPlayerOpened, OnPlayerReleased• OnPlayerSeekCompleted

Using the Player class

Create Player instance

Load file & play

__pPlayer = new Player;__pPlayer->Construct(*pListener);

// IPlayerEventListener

result r = __pPlayer->OpenFile(__path);if (IsFailed(r)) return;__pPlayer->Play();

__pPlayer->Stop();__pPlayer->Close();

Complex method

Record PCM data

AudioIn class– Record raw uncompressed PCM data from

microphone– Double buffering is possible

Event Listener– IAudioInEventListener

• OnAudioInBufferIsFilled• OnAudioInInterrupted• OnAudioInReleased

Using the AudioIn class

Create AudioIn instance

Feed buffers and start recording

Feed next buffers

__pAudioIn = new AudioIn();__pAudioIn->Construct(*__pListener);__pAudioIn-> Prepare (AUDIO_INPUT_DEVICE_MIC, AUDIO_TYPE_PCM_U8, AUDIO_CHANNEL_TYPE_STEREO,8000);

__pAudioIn->AddBuffer(__pByteBuffer1);__pAudioIn->Start();

void Listener::OnAudioInBufferIsFilled( Osp::Base::ByteBuffer* pData){ // save result.

pData->Clear();__pAudioIn->AddBuffer(pData);

Play PCM data

AudioOut– Play raw uncompressed PCM data– Double buffering is possible

Event listener– IAudioOutEventListener

• OnAudioOutBufferEndReached• OnAudioOutInterrupted• OnAudioOutReleased

Using the AudioOut class

Create AudioOut instance

Feed PCM data

Play sound

__pAO = new AudioOut();__pAO->Construct(*pListener);// IAudioOutEventListener__pAO->Prepare(AUDIO_TYPE_PCM_S16_LE,

AUDIO_CHANNEL_TYPE_MONO, SAMPLERATE);__pOutBuffer = new ByteBuffer();__pOutBuffer->Construct(BUFSIZE);

// Fill buffer__pAO->WriteBuffer(*__pOutBuffer);

__pAO->Start();

Using the AudioOut class ctd.

Process events

Stop sound__pAO->Stop(); //or Reset()

void EventListener::OnAudioOutBufferEndReached(Osp::Media::AudioOut &src){ //Feed Next PCM data }

Double buffering in AudioIn

AudioIn DeviceStep 1. Initialize AudioIn Recording

application

AudioIn DeviceStep 1. Initialize AudioIn

Step 2. Add two buffers

Buffer1

Buffer2

Recordingapplication

Step 3. Start recording

Step 4. Buffer1 is filled

Buffer1

Buffer2

Step 5. Event is fired Buffer2 is used by AudioIn

Buffer1

Buffer2

Event: Buffer is filled

Step 6. App. reads Buffer1and AudioIn writes to Buffer2

Buffer1

Buffer2

Buffer1

Buffer2

Event: Buffer is filled

Step 7. Event is firedAudioIn switches to Buffer1

Buffer1

Buffer2

Step 7. Event is firedAudioIn switches to Buffer1Step 8. Read Buffer2

Double buffering in AudioOut

AudioOut DeviceStep 1. Initialize AudioOut Player

application

AudioOut DeviceStep 1. Initialize AudioOut

Buffer1

Buffer2

Playerapplication

Step 3. Start playback

Step 4. Buffer1 is read

Buffer1

Buffer2

Playerapplication

Step 5. Event is fired Buffer2 is used by AudioOut

Buffer1

Buffer2

Event: Buffer end is reached

Playerapplication

Step 6. AudioOut reads Buffer2 and app writes to Buffer1

Buffer1

Buffer2

Playerapplication

Buffer1

Buffer2

Event: Buffer end is reached

Step 7. Event is firedAudioOut switches to Buffer1

Playerapplication

Buffer1

Buffer2

Step 7. Event is firedAudioOut switches to Buffer1Step 8. Write to Buffer2

Playerapplication

Simple Mixing

Why mixing?

Play many sounds simultaneously– Limited number of player instances– System resource limited

Performance issue– Consume less computing power

Flexibility– Finer control of PCM data is possible

.wav file

Important .wav header fields

Field Name

Chunk IDChuck Size

FormatSubchunk1 ID

Subchunk1 SizeAudio Format

Num ChannelsSample Rate

Byte RateBlock Align

Bits Per SampleSubchunk2 ID

Subchunk2 Size

RIFFHeader444

WavFormatInfo

42244224

ChnkHeader4

Field Offset(bytes)

Field Size

(bytes)

Field ValueChannels mono/stereoSample rate 8/22/44.1KhzBit per sample 8bit /16bitSize raw data sizePCM data raw data

Loading .wav file

Open file

Read header

Read PCM data

File f;f.Construct(/*File Path*/, String(L"r"));

f.Read(&__RIFFHeader, sizeof(RIFFHEader));f.Read(&__WavFormat, sizeof(WavFormatInfo));

ChnkHeader tmp;f.Read((void *)&tmp, sizeof(ChnkHeader));__pData = new Osp::Base::ByteBuffer;__pData->Construct(tmp.size);f.Read(*__pData);__pData->Rewind();

Simple mixing

Step 1: Create buffers

Step 2: Add the buffers

__pTmpBuf = new ByteBuffer();__pTmpBuf->Construct(size*4); //int type

int* pTmp = static_cast<int *> (__pTmpBuf->GetPointer());

short* pData1 =static_cast<short *> (__pData1->GetPointer());

short* pData2 =static_cast<short *> (__pData2->GetPointer());

for (int i = 0; i < size; i++)pTmp[i] = pData1[i] + pData2[i] ;

Simple mixing

Step 3: Clip the buffers

Step 4: Write the buffer to AudioOut

short * pOut = static_cast<short *> (__pOutBuf->GetPointer());

for( int i=0;i<size;i++){

if (pTmp[i] >= SHRT_MAX) pOut[i] = SHRT_MAX*;else if ( pTmp[i] <= SHRT_MIN) pOut[i] = SHRT_MIN*;else pOut[i] = pTmp[i];

__pAO->WriteBuffer(*__pOutBuf);

*SHRT_MAX, SHRT_MIN: maximum and minimum values of short type

Image & Video management• Image

• Video

• Streaming

Can encode, decode, convert images

Supported pixel format– RGB565/ARGB8888/R8G8B8A8

Decoding– BMP, GIF, PNG, TIFF, WBMP

Encoding– BMP, JPEG, PNG

"IMAGE" privilege is needed

Image class decode/encode

Load image

Save image

Bitmap* LoadBitmapN(const String& name){

Bitmap* pBitmap = null;Image* pImage = new Image();pImage->Construct();pBitmap = pImage->DecodeN(name,

BITMAP_PIXEL_FORMAT_ARGB8888);delete pImage;return pBitmap;

pImage->EncodeToFile(*pBitmap, IMG_FORMAT_PNG, name, true);

Video playing

Can play video using Player class– Using OverlayPanel to display video

Code snippet– Create player

– Open file

– Play/stop/pause/close

pPlayer = new Player();pPlayer->Construct(*pListener, &bufferInfo);

pPlayer->OpenFile(String(L"/Res/badaBI.mp4"));

pPlayer->Play(); //Pause() or Stop() or Close()

OverlayPanel

Primarily used for the playback of camera previews or video– Foreground panel

• Overlay graphics and controls– Background buffer

• Support H/W accelerated rendering

Foreground panel

Input bufferMasking color

Background buffer

OverlayPanel ctd.

Create a panel and get bufferInfo

Use the bufferInfo in the Player class

pPanel= new OverlayPanel();pPanel->Construct(rect);AddControl(*pPanel);pPanel->GetBackgroundBufferInfo(bufferInfo);

pPlayer->Construct(*pListener, &bufferInfo);

Streaming

Can play audio/video streaming content– Supported protocol : RTSP – Supported video codecs : MPEG4, H.263,

H.264 – Supported audio codecs : AAC, HE-AAC,

Enhanced-AAC+, AMR-NB

pPlayer->OpenURL(String(L“RTSP://IP address/content"));

MediaPlayer– Video Playback– OverlayPanel

Tips for Performance

Preffered PCM format to reduce internal operations

Double buffering to reduce latency

Sound mixing can reduce internal resources and event processing

Field ValuesChannels stereoSample rate 44.1KhzBit per sample 16bit

Tips for Programming

Handled automatically by platformHeadset • Plug and unplug events are not fired

• Platform changes the sound path automaticallyIncoming call

• Player, AudioIn, and AudioOut are stopped by platform• Resuming should be done by application

(Osp::App::Application::OnForeground)

Tips for Programming

Handled by applicationSilent mode • Event is not fired

• Application should check silent mode (Osp::System::SettingInfo )

Side volume key

• Application should deal with volume controls• Application handles key event

(Osp::Ui::IKeyEventListener)Foreground/ background

• Player consumes too much power• On background, stop playing audio and video

Summary

What we have learned

Basic way to record and play audio– AudioRecorder / Player classes

Playing and recording PCM data– AudioIn / AudioOut classes– Wav file format / Simple mixing

Image and Video management– Image encode/decode – OverlayPanel for video– Streaming both audio and video

Find out more

Tutorial– bada Tutorial.Media.pdf

Samples – MediaPlayer– VoiceRecorder

Dive intohttp://www.goprodiver.com54

sounds in bada

samsung electronics

play pcm dataaudioout

raw pcm datacopyright

new player

streaming streaming

new audioout

recording audiorecorder

recording audioin

Education

007 bada user manual

the principal 08010100101 gups 9 h bada 9 h bada doulatpura...

bada leadership meeting

bada tutorial.web

bada imambara

toozla for samsung wave (bada)

bada (bada heavy industries) catalog - shipserv

bada user manual

eurocontrol experimental · pdf filereport documentation...

004 bada basics fundamentals&ui

bada open source license information

bada order tvc

jeffrey l. bada scripps institution of oceanography...

bada bazar, delhi, home appliances

bada et al., 1999 regional geological database for deep...

ashok leyland expands lcv portfolio with ‘bada...

bada basics fundamentals & ui

abdulrahman bello bada - core · abdulrahman bello bada ......

joey bada$$, "like me"

bada waala connect