Multimedia Computing Syllabus - Elective I

Tribhuvan University

Institute of Science and Technology

Bachelor of Science in Computer Science and Information Technology

Course Title: Multimedia Computing

Course no: CSC319

Semester: V

Nature of course: Theory + Lab

Full Marks: 60 + 20 + 20

Pass Marks: 24 + 8 + 8

Credit Hours: 3

Course Description : This course covers the basic concepts of Multimedia system including introduction, Sound / Audio System, Images and Graphics, Video and Animation, Data Compression, User Interfaces, Abstractions for programming and Multimedia Application

Course Objective : This course covers three main objectives on multimedia system these are devices, systems and applications.

Course Contents:

Unit 1. Introduction to Computers 3 Hrs.

Introduction: Introduction To multimedia system , history and applications

Global structure of Multimedia : Device domain, system domain, application domain, cross domain with diagram

Multimedia Application: Basic applications of multimedia system in all sectors

Medium : The perception medium, the representation medium, the presentation medium, the storage medium, the transmission medium, the information exchange medium, representation values and representation spaces, representation dimensions

Multimedia system and properties: Combination of media, independence ,computer support integration

Characteristics of a Multimedia System: Multimedia systems must be computer controlled, Multimedia systems are integrated, the information they handle must be represented digitally, the interface to the final presentation of media is usually interactive.

Challenges for Multimedia Systems: Synchronization, Sequencing, Distributed Network, Inter-media Scheduling

Components of a Multimedia System: Capture devices, Storage Devices, Communication Networks, Computer Systems, Display Devices.

Unit 2. Sound/Audio System 6 Hrs.

Concepts of sound system: Frequency, amplitude, Computer representation of sound, sampling rate, quantization, sound hardware

Music and Speech : Basic MDI concepts, MIDI Devices, MIDI messages, MIDI and SMPTE timing standards, MIDI software

Speech Generation : Basic Notions, Reproduced Speech output, Time dependent sound concatenation, frequency – dependent sound concatenation

Speech Transmission: Signal form coding, source coding in parametrized systems, recognition and synthesis systems

Unit 3. Image and Graphics 5 Hrs.

Digital Image Representation : Image format, storage image format

Image and graphics Format : Introduction about different Image and graphics Format

Image Synthesis , analysis and Transmission : Computer Image processing, dynamics in graphics, the framework of interactive
graphics systems: Graphics input/ output hardware, dithering, image analysis, Image recognition, Image recognition steps, Image transmission

Unit 4. Video and Animation 6 Hrs.

Video signal representation : Visual representation, Transmission, digitalization

Computer Video Format : Introduction to Computer video format

Computer- Based animation : Input process, composition stage, in between process, Changing colors,

Animation Language: Linear list notations, General purpose language, Graphical Languages

Methods of controlling Animation: Full explicit control, procedural control, constraint based systems, tracking live action, kinematics and dynamics,

Display of Animation: Basic knowledge about Display of Animation

Transmission of Animation: Basic knowledge about Transmission of Animation

Unit 5. Data Compression 8 Hrs.

Storage Space : Basic knowledge about Storage Space

Coding Requirements : Basic knowledge about Coding Requirements

Source, Entropy and Hybrid Coding: Entropy coding, source coding- Huffman Encoding, Arithmetic encoding (introduction only), Run length encoding,

Lossy Sequential DCT based Mode : Steps of Lossy Sequential DCT

Expanded Lossy DCT based Mode : Steps of Expanded Lossy DCT-based Mode

JPEG and MPEG : JPEG and MPEG compression process

Unit 6. User Interfaces 5 Hrs.

Basic Design Issues : Architectural issues, information characteristics for presentation, presentation function, presentation design knowledge, effective human computer interaction

Video and Audio at the User Interface: Classification of software: system software and application software, audio and video at the user interface

User- friendliness as the Primary Goal : Easy to learn instruction, presentation, Dialogue boxes, additional design criteria, design specific criteria

Unit 7. Abstractions for Programming 5 Hrs.

Abstractions Levels: Abstraction level of the programming of multimedia systems

Libraries: Introduction to Libraries

System Software: Data as Time capsules, data as Streams,

Toolkits : Introduction to toolkits

Higher Programming Languages: Media as types, Media as files, Media as processes, programming language requirements, Interprocess communication Mechanism, language,

Object –oriented approaches: Class, object, Inheritance, Polymorphism, application-specific metaphors as classes, application-generic Metaphors as classes, devices as classes, processing units as classes, Distribution of BMOs and CMOS, Media as classes, Communication-specific Metaphors as classes

Unit 8. Multimedia Application 5 Hrs.

Media preparation and composition: Means, video support, scanner devices, recognition devices, tracking devices, motion based devices,

Media integration and communication: Multimedia editors, Hypermedia/ Hypertext editors, authoring tools, tele-services, interactive services, Distributed services, Media ConsumPtion

Media Entertainment: Virtual Reality, Interactive video, Interactive audio, Games

Telemedicine: Application of Telemedicine in Multimedia

E-learning: Application of e-Learning in Multimedia

Digital video editing and production systems: Application of in Digital video editing and production systems in Multimedia

Video conferencing: Application of Video conferencing in Multimedia

Video-on-demand: Application of Video-on-demand in Multimedia

Laboratory Works:

After completing this course, students should have practical knowledge of different components of multimedia system, multimedia tools and applications. The laboratory work includes: Macromedia FreeHand Macromedia Flash Swish Max Macromedia Director Morphing techniques Audio and Video editing software Data compression

Text Books:

Multimedia: Computing, Communications and Applications, Ralf Steinmetz and Klara Nahrstedt, Pearson Education Asia

Reference Books:

- Multimedia Communications, Applications, Networks, Protocols and Standards, Fred Halsall, Pearson Education Asia
- Multimedia Systems, John F. Koegel Buford, Pearson Education Asia