WO2008033156A9

WO2008033156A9 - Interactive digital media services

Info

Publication number: WO2008033156A9
Application number: PCT/US2007/000965
Authority: WO
Inventors: James Morrison; Bonet Jeremy B De; Scott Hughes
Original assignee: Smartvideo Technologies Inc; James Morrison; Bonet Jeremy B De; Scott Hughes
Priority date: 2006-09-12
Filing date: 2007-01-12
Publication date: 2008-05-08
Also published as: WO2008033156A1; US20080077956A1; US20080065507A1

Abstract

Methods, systems, and apparatus, including computer software, for interactive digital media service is presented. A content provider streams secondary content, such as images, chatroom discussions, offer's for sale, promotions, advertisements, contests, or surveys, along with primary media content, such as radio or television programs, to multiple consumer devices. The consumer can interact with the content provider by sending messages in real time, and the content provider can edit or modify the primary media content or secondary content based on the received messages. The consumer can also order commercial transactions, such as buy products offered for sale, download digital content, songs, ringtones, and screensavers. An operator of the system can manage and control the primary and secondary content and modify them in real time according to the consumer interaction. The content provider can also build a consumer data base based on the consumers' communications.

Description

INTERACTIVE DIGITAL MEDIA SERVICES

BACKGROUND

[0001] The present invention relates to digital media programs, more precisely to interactive digital media services.

[0002] Digital media programs are audio, video or multimedia programs in digital format. For example, digital media programs can include digital radio or television programs. The digital media programs can be streamed to multiple consumers, for example, by radio or television stations, from satellites, through cable or a telephony network (e.g., Digital Subscriber Line (DSL)), over the Internet, or by any other suitable means. More recently, digital media programs, such as digital radio or television programs, are streamed to consumers over wireless or cellular networks. For example in a network that uses information packets, the digital media programs can be streamed to the consumer devices using broadcast, multicast, or unicast packets.

[0003] The streamed media programs can be received by consumer devices configured to receive and process the digital media content. For example, digital radio programs can be received by specially designed digital radio receivers or other digital devices such as desktop computers or portable digital devices, such as laptop computers and handheld devices, for example, cell phones, smartphones, pocket PCs, palmtops, or personal digital assistants (PDAs).

[0004] The digital media programs are typically organized into one or more program channels, where each program channel represents a separate, realtime stream of media content. The digital media programs are provided for each program channel by one or more respective media content providers. For example, a radio content provider often generates radio programs by recording audio content at a particular location, typically in a studio. The recorded audio content can be streamed to the consumers "live," i.e., without substantial delay, or at a later time that would allow editing the audio content. For example, a typical radio program often includes a collection of pre-recorded music or audio advertisements interrupted with live content, such as interviews, comments and announcements presented by a DJ. In most cases, the flow of the service is one way: the listeners or consumers only receive the program, but cannot interact with the content provider.

[0005] In those cases where some interaction is possible, the radio listener can use only communication channels that are separate and different from the one through which the radio program is received. For example, the radio listener can telephone the DJ, or use traditional or electronic mail. Similar to radio programs, live television programs typically allow consumers to interact with a program host by telephone or traditional or electronic mail. Thus, the interaction is often slow and unorganized, and consequently, the content provider rarely modifies the radio or television content in response to the consumer communication. In some systems, a mobile device includes a "good old FM radio" to receive traditional analog radio broadcast through the air, and the mobile device is also capable to use a digital network to send messages to the radio station or receive visual information related to current FM radio programs. Thus, similar to the other traditional systems, the information exchange about the radio program happens through a communication channel that is separate and different from the one through which the radio program is received.

SUMMARY

[0006] Briefly and generally, embodiments of the present invention provide an interactive digital media service, which allows a media content provider to select and stream secondary content, such as studio shots, images, commercial offers, promotions, advertisements, or surveys, along with primary media content through a communication network to multiple consumer devices. The consumer devices can be configured to present both the primary media content and the secondary content, including commercial components such as offers for sale, promotions, direct response advertisements, contests, or surveys. The consumer can use the same communication network to interact with the content provider by sending messages to the media content provider in real time, for example, in response to the secondary content or any other content. The content provider can edit or modify the primary media content or secondary content elements based on the received messages. The radio content provider can also build a consumer data base based on the consumers' interactive communications.

[0007] In general, in one aspect, the present invention provides methods, system, and apparatus, including computer software products, for providing a "visual" radio experience. Digital content is streamed to an audience comprising at least one consumer device, wherein the digital content includes primary media content and secondary content. Communication initiated at the consumer device is received, where the received communication relates to the primary media content or the secondary content. The communication is relayed to a media distributor or a content provider, whereby providing feedback for controllably selecting the primary media content or the secondary content.

[0008] Particular implementations can include one or more of the following features. The step of controllably selecting the secondary content can include presenting on a computer-controlled display a plurality of icons representing visual assets which are contextually related to the primary media content. A scheduler can be operated for preselectably and dynamically designating a series of the icons to be streamed to the audience. An on-air indicator can be provided on the display for identifying one of the icons as corresponding to a visual asset designated for current streaming to the audience. A selector can be provided to selectably alter the order of the icons in the series, or to add icons to or remove icons from the series. An editor can be provided for creating an icon representing a new visual asset and for editing an icon representing a pre-existing visual asset. A representation of text messages received from at least one member of the audience can be presented on the display. Thus, a visual radio experience can be controllably provided by allowing a plurality of visual assets or the textual representation to be selectably streamed to the audience in controllable correlation with the streaming of the primary media content. Offers to sell can be provided in at least one of the visual assets in the streamed assets. Surveys can be selectably included in the streamed assets. A text editor can be provided for editing a caption or price information for a visual asset to be streamed. At least one of the icons can correspond to a visual asset comprising a ringtone, a digital wallpaper, an image, a video clip, downloadable digital data, or a game.

[0009] In general, in another aspect, the present invention provides methods, system, and apparatus, including computer software products, for providing an interactive content experience. Primary media content and secondary content are received. The primary media content is streamed to at least one mobile device. The secondary content is streamed to the same mobile device. The secondary content includes a series of visual assets controllably selected for streaming in temporal or contextual correlation with the primary media content. Interactive responses relating to at least one of the visual assets are received from the mobile device.

[0010] Particular implementations can include one or more of the following features. The series of visual assets can be altered by adding, removing, deleting, or changing the order of visual assets in the series. The primary media content can be altered in response to at least one of the interactive responses.

[0011] In general, in another aspect, the present invention provides methods, system, and apparatus, including computer software products, for providing an interactive visual radio experience. A streaming radio program is received at a programmable mobile device. A series of icons corresponding to visual assets is received at the mobile device, wherein the icons have been controllably selected for streaming. The icons are depicted on a display on the mobile device. Interactive capability is provided for a user of the mobile device. Thus, the mobile device provides both a radio program and visual assets concurrently with an interactive capability. The visual radio experience of some of these embodiments can be viewed as a smart mobilecasting system. [0012] Particular implementations can include one or more of the following features. The radio program can include primary media content. The series of icons can include secondary content. Providing interactive capability can include one or more of providing a selector for initiating a request to buy a visual asset, providing text messaging capability for a user of the mobile device, providing a survey capable of being responded to by a user of said device, and providing a contest capable of being entered by a user of said device.

[0013] Particular embodiments can be implemented to realize one or more of the following advantages. The interactive streaming system can provide instant interaction using instant messaging (IM), comments or messages directed to the DJ, a studio guest, a talk show host, and other listeners. The interactive streaming system can deliver complete downloads, songs, ringtones, games, screensavers, and any computer applications to the consumers. The consumer devices can receive secondary content elements and display such elements along with presenting the primary media content. The secondary content elements can be displayed, for example, using split screen applications. Thus, the consumer can view both a video and a dedicated IM chatroom related to a current program or another topical chatroom. Or , the consumer can view a video and an offer to sell, or a photo or a textual presentation and an offer to sell, or any other combination. The consumer device can also display a program front page, an image of the host, a photo of a guest, a video selected by the DJ or the host, an activity in the studio, advertisements, promotions, or media programming data, such as starting or remaining time, time of a next show, guest list, or upcoming topics. The consumer device can also display other program related data, such as sports statistics, or a portal to a music store or a mobile content or application store. The interactive streaming system also enables the consumer to buy and download entire songs, ringtones, or screen savers and wallpapers. The system can also provide a portal to m-commerce services. The consumer can use convenient selectable icons, e.g., to buy an advertised item or to choose a previous show.

[0014] Furthermore, particular embodiments can provide all functionality from within one application. Thus, multiple functionalities can be converged. A consumer can interact with the content provider without exiting from currently running applications, such as a current Wireless Application Protocol ("WAP") session. For example, a consumer can interact with a radio broadcast without opening a new application or WAP session. In such an integrated messaging application the consumer can send a text message without exiting the current session, then prompting a text session, then restarting the current application. To implement the interactive digital media service, the consumer devices can include corresponding computer software. The software can be pre-loaded in the device or downloaded at a later time by the consumer. For example, the consumer can download the software onto a mobile device over the air by sending a keyword to a short code, such as the call letters of their local station. Or the consumers can call an interactive voice response ("IVR") number. The software can be sent to the consumer's mobile device through an SMS link. The interactive digital media service can be implemented to transmit different types of digital content or to invoke different digital data services. For example, the interactive digital media service can be implemented to transmit data using Voice over Internet Protocol ("VOIP"). Or, the interactive digital media service can implement a Push To Talk ("PTT") system to connect with the content provider by leaving a verbal message. The interactive digital media service can also be implemented to use a peer-to-peer

("P2P") functionality. For example, information exchange between a community of consumers can be directed by a content provider or a moderator live through a system that also prompts input from other sources, such as a Radio, TV or any other content providers. The interactive digital media service can be implemented to stream content originated from two or more content sources. The visual or other assets to be streamed can be managed by the content provider in real time. The content provider can use software applications that are configured to manage consumer interactions automatically, i.e., without a human operator's interaction. For example, the content provider can use software applications configured to respond or otherwise react to consumer responses or requests automatically. Thus, the content provider can utilize the functionality of automatic response during interactive media programming. This may allow a talk show host or a DJf to engage the audience, in particular during periods, such as late at night, when there would be little or no interaction. For example, the software application can present preprogrammed advertisements or music information based upon a preset playlist. The interactive digital media service can be accessed by Internet enabled devices. The consumer's device can be personalized by the consumer. Thus, the consumer can implement a unique feature. For example, the consumers can listen to their local stations while traveling. Or the consumers can follow international broadcasts. The interactive digital media service can be implemented to use location based services ("LBS")- Thus, some of the consumers can be selectively included or excluded from accessing a particular content portion. Or the system can provide content, such as targeted promotions or advertising, that is particularly relevant to listeners in a particular geographic region. The consumer can also conduct commerce transactions or participate in promotions. The consumer can also create content and share the created content with the content provider, an advertiser or other community members using the interactive digital media service. The consumer created content can include text, SMS, images, video, Microsoft Media Services (MMS) or other media content. The consumer can share content without stopping the current application and restarting another application to invoke a different functionality, such as communication with other consumers, content providers or advertisers.

BRIEF DESCRIPTION OF DRAWINGS

[0015] FIGs. 1A-2B are schematic block diagrams illustrating interactive digital media streaming systems.

[0016] FIGs. 3 and 4 are schematic block diagrams illustrating secondary content elements and commercial servers, respectively, for interactive digital media streaming systems.

[0017] FIGs. 5-7 are schematic flow charts illustrating methods for interactive digital media streaming systems.

[0018 J FIGs. 8 A and 8B illustrate exemplary screen shots generated by user interfaces for interactive digital media streaming systems.

10019] FIG. 9 is a schematic flow chart illustrating interactive operation of a media provider.

[0020] FIG. 10 is a schematic flow chart illustrating interactive operation of a consumer interaction service provider.

[0021] FIG. 11 is a schematic flow chart illustrating interactive operation of a communication network. [0022] FIG. 12 is a schematic flow chart illustrating interactive operation of a consumer device.

[0023] FIGs. 13A-E are illustrating exemplary screen shots related to interactive operation of consumer devices.

[0024] FIG. 14 is a schematic flow chart illustrating commercial operation of a content provider.

[0025] FIG. 15 is a schematic flow chart illustrating commercial operation of a media provider.

[0026] FIG. 16 is a schematic flow chart illustrating commercial operation of a consumer interaction service provider. [0027] FIG. 17 is a schematic flow chart illustrating commercial operation of a communication network.

[0028] FIG. 18 is a schematic flow chart illustrating commercial operation of a consumer device.

[0029] FIG. 19 is a schematic flow chart illustrating commercial operation of a consumer device.

[0030] FIGs. 20A-C illustrate exemplary screen shots related to commercial operation of consumer devices.

DETAILED DESCRIPTION

[0031] FIG. IA illustrates an interactive digital media streaming system 100 according to one aspect of the present invention. The interactive media streaming system 100 can be used to stream digital media content along with additional content to multiple consumers and allow the consumers to respond to the received content in real time. In one implementation, the system 100 is used to stream digital radio or television programs to multiple consumers, where the consumers can respond to commercial elements in the received content or interact with each other or a live operator of the currently streamed television or radio program. Alternatively, the system 100 can be used to stream any other media content to multiple consumers and allow the consumers to interact with each other, an operator of the current content stream, or other parties related to the streamed content.

[0032] The interactive media streaming system 100 includes a content provider 1 10, an interactive program provider 120, a communication network 130, and an audience including multiple consumers with their respective devices, such as consumer devices 140 and 145. The content provider 110 provides content to the interactive program provider 120, which forms a content stream 150 from the received content and streams the content stream 150 through the communication network 130 to the consumer devices 140 and 145. The consumer devices 140 and

145 receive the streamed content and present it to their respective users, i.e., the consumers. The consumers can use their respective consumer devices 140 and 145 to interact with the interactive program provider 120 or the content provider 110 in response to the received content. For example, the consumer devices 140 and 145 can establish respective interactions 160 and 165 to send information through the network 130 back to the interactive program provider 120. The interactive program provider 120 can process the information received from the consumers and transmit the processed information to the content provider 110, or to one or more other service providers (not shown).

[0033] The content provider 110 provides primary media content 1 11 and secondary content 112 and includes a stream editor 115 to review and edit the primary media content 11 and the secondary content 112 for streaming by the interactive program provider 120. The primary media content 111 includes media programs of primary interest that are streamed to the consumer devices 140 and 145 and presented to their respective users. The secondary content 112 is streamed along with the primary media content 112, and includes content to be presented to the consumers in addition to the primary media content 111. For example, the primary media content 1 11 can include radio or television programs, and the secondary content 112 can include text, images or videos to be displayed while the consumer listens to a radio program or watches a television program.

[0034] The primary media content 1 11 can be organized into one or more program channels, where each program channel represents a separate flow of media content. For each program channel, the primary media content 111 can include prestored media content, such as images, music or other audio recordings, videos, movies, pre-recorded television or radio shows. The primary media content 11 1 can also be generated "live" by the content provider 110. For example, the content provider 110 can record video or audio programs in a studio and transmit the recorded material to the consumers without substantial delay.

[0035] In one implementation, the primary content 111 includes video content, such as television programs or any other video programs. For example, the primary content 1 1 1 can include a live video program, a pre-recorded video program, a TV program, a webcast, a podcast, or any equivalents. The video content can be formatted or compressed using any suitable format or techniques, such as those provided by Audio Video Interleave (AVI), Windows Media, MPEG4, Quicktime, Real Video, or Shockwave/Flash format, or any equivalent techniques.

[0036] The secondary content 112 includes content elements that can be presented along with the primary media content 11 1. For example, the secondary content 112 can include text elements, image elements, or small video elements that can be presented "on the side" while the consumer also watches or listens to the primary media content 111. The secondary content 112 can include pre-stored elements, such as graphics, animations, photographs or video clips. The secondary content 1 12 can also include elements generated "live" by the content provider 110. For example, the content provider 110 can take live snap shots in the studio, or generate text or graphical representation of live consumer interaction, such as live consumer messages or results of live consumer surveys or contests.

[0037] The stream editor 115 includes a secondary content selector 1 16, a consumer interaction manager 117, and a user interface 1 18. The secondary content selector 116 selects elements of the secondary content 1 12 to be streamed along with the primary content 111, and the consumer interaction manager 117 manages interaction with the consumer devices 140 and 145. The user interface 118 allows an operator to monitor and edit content to be streamed, and to manage the secondary content selector 116 and the consumer interaction manager 117.

[0038] The secondary content selector 116 can select and schedule elements of the secondary content 112 for streaming to consumers. The secondary content elements can be selected or scheduled automatically according to a predetermined schedule or predetermined rules. For example, the secondary content selector 116 can include an artificial intelligence device to pre-sort and pre-schedule elements of the secondary content 1 12 into a streaming schedule. The secondary content selector 116 can also select elements of the secondary content 112 for streaming based on user input received from the user interface 1 18. Based on the received user input, the secondary content selector 116 can also delete, alter or reschedule elements of the secondary content 112 for streaming. Thus, the operator can use the secondary content selector 116 to control the selection and timing of the secondary content elements that are streamed along with the primary media content 111.

[0039] In one implementation, the content provider 110 can also use time shifting for streaming the primary content 111 or the secondary content 1 12. For example, one or more media programs can be recorded and the recorded media programs can be placed in a linear loop that plays over and over until the next live show begins. Thus, the consumers can access the programs streamed in the loop as they are being played back. That is, the streamed programs cans be accessed at the point that is currently streamed, depending on the current timing of the streamed loop. Alternatively, the recorded media programs can be streamed on the consumers' demand (commonly referred to as "on demand" service) starting from the beginning and playing to the end of the recorded program or programs.

[0040] The consumer interaction manager 117 receives information communicated by the consumer devices 140 and 145 while content is streamed to those devices. For example, the consumer interaction manager 1 17 can receive text messages, survey and contest responses, or other consumer communications related to the currently streamed primary media content 111 or secondary content 112. The consumer interaction manager 117 can also process the received consumer information. For example, the interaction manager 117 can format the received consumer information for presentation in the user interface 118 or as an element of the secondary content 1 12. Or the interaction manager 117 can parse consumer messages and select or rank them based on the level of their relevance. Optionally, the consumer interaction manager 117 can also receive and process consumers' responses to commercial elements, such as offers for sale, advertisements or promotions that have been streamed to the consumer devices 140 and 145 as secondary content elements along with the primary media content 111. [0041] In one implementation, the interaction manager 117 can also evaluate the received consumer information and record results of the evaluation. Thus, the consumer interaction manager 117 can determine and record one or more features of the received consumer communications. The determined and recorded features can include survey or contest results, individual or overall responses to advertisements or promotions, or other statistical features of the consumer communications. The consumer interaction manager 117 can also manage and update a consumer data base based upon the received consumer communications. In alternative implementations, one or more functions of the consumer information manager 1 17 can be performed, at least in part, by the interactive program provider

120.

[0042] The user interface 118 displays information received from the secondary content selector 116 and the consumer interaction manager 1 17. The user interface 118 can also receive user input from an operator of the stream editor 1 15 to control the secondary content selector 1 16 and the consumer interaction manager

117. The user interface 118 can also display information related to the primary media content 111 or the secondary content 112. Thus, the user interface 1 18 allows the operator to monitor and edit content to be streamed to the consumer devices 140 and 145. The same or a different operator can also use the user interface 1 18 to control the consumer interaction manager 1 17 in order to manage consumer communication while the content is streamed.

[0043] The interactive program provider 120 includes a media distributor 121 and a consumer interaction service provider 125. The media distributor 121 streams the content stream 150 through the communication network 130 to the consumer devices 140 and 145, and the consumer interaction service provider 125 processes communications received through the network 130 from the consumer devices 140 and 145 in response to the content stream 150. The media distributor 121 and the consumer interaction service provider 125 can share or exchange information. Thus, the media distributor 121 can receive consumer information from the consumer interaction service provider 125, and the consumer interaction service provider 125 can receive information about the content stream 150.

[0044] The media distributor 121 receives the primary media content 111 and the secondary content 112 from the content provider 110. The media distributor 121 includes a stream server 123 that composes the content stream 150 from the received content. Thus, the stream server 123 streams the primary media content

111 and the secondary content 112 through the communication network 130 to the consumer devices 140 and 145.

[0045] Optionally, the media distributor 121 can also receive communications from the consumer devices 140 and 145, and forward the received communications to the consumer interaction service provider 125. Or the media distributor 121 can receive information from the consumer interaction service provider 125, and forward the received information to the consumer devices 140 and 145 or to the content provider 1 10.

[0046] The consumer interaction service provider 125 receives and replies to communications initiated at the consumer devices 140 and 145. The consumer interaction provider 125 can also record, process, or forward the consumer communications. For example, the consumer interaction service provider 125 can determine and record one or more features of the received consumer communications. The determined and recorded features can include survey or contest results, individual or overall responses to advertisements or promotions, or other statistical features of the consumer communications. The consumer interaction service provider 125 can also manage and update a consumer data base based upon the received consumer communications. Optionally, the consumer interaction service provider 125 can forward the original or the fully or partially processed consumer communications to the media distributor 121 , the consumer interaction manager 117, or any other service providers (such as order fulfillment services, not shown).

[0047] The consumer interaction service provider 125 includes one or more consumer interaction servers 127 to process and forward incoming consumer communications and to generate appropriate responses to the consumer devices 140 and 145. For example, the consumer interaction servers 127 can record, sort, or redirect the incoming user communications. The consumer interaction servers 127 can also respond to the received consumer communications, for example, by sending acknowledgments to or requesting information for commercial or financial transactions from the consumer devices 140 and 145. The consumer interaction servers 127 can also include digital publication servers that can receive orders for digital content from the consumer devices 140 and 145, and transmit the ordered content to the consumer devices 140 and 145.

[0048] The communication network 130 transmits the content stream 150 to the consumer devices 140 and 145 and establishes, at least in part, the interactions 160 and 165 between the interactive program provider 120 and the respective consumer devices 140 and 145. For each of the consumer devices 140 and 145, the communication network 130 can use the same or different communication channels for transmitting the content stream 150 and establish the respective interaction 160 or 165. The communication network 130 can use any appropriate protocol to transmit the content stream 150 or the consumer communications.

[0049] In one implementation, the communication network 130 is configured to transmit the content stream 150 to a large number of consumer devices, including the consumer devices 140 and 145. For example, the communication network can include one or more public or private, wired or wireless networks that cover many consumer devices or a large geographical area. Thus, the communication network 130 can include, at least in part, the Internet, wide area networks (WANs) or local area networks (LANs)₅ cable networks, wired or wireless telephone networks. The communication network 130 can transmit the content stream 150 using broadcast, multicast or unicast information packets directed to each of the consumer devices 140 and 145. For example, the content stream 150 can be transmitted with podcasting. [0050] The consumer devices 140 and 145 are digital devices configured to receive the content stream 150 and to communicate through the communication network 130. For example, the consumer devices 140 and 145 can include nonportable or portable digital radio or television devices, desktop computers, or portable digital devices, such as laptop computers and handheld devices, for example, cell phones, smartphones, palmtops, or personal digital assistants (PDAs).

[0051] The consumer devices 140 and 145 include content stream receivers 142 and 147, and consumer interaction units 144 and 149, respectively. Each of the content stream receivers 142 and 147 is configured to receive and present the user with the primary media content 111 in the content stream 150. For example, if the content stream includes a digital radio or television stream, the content stream receivers 142 and 147 include respective digital radio or television receivers. The content stream receivers 142 and 147 can also be configured to receive and present secondary content elements that are streamed along with primary media content 111 in the content stream 150.

[0052] The consumer interaction units 144 and 149 are configured to receive user input from the respective consumer and to transmit corresponding consumer communications to the content provider 110 or the interactive program provider 120 through the communication network 130. The consumer interaction units 144 and 149 can also be configured to receive and process communication, such as acknowledgements or requests for information from the content provider 110 or the interactive program provider 120.

[0053] The consumer interaction units 144 and 149 can use the same or different communication channel to transmit the consumer communications than the channel through which the content stream 150 is received. In one implementation, the consumer interaction units 144 and 149 can transmit the consumer communications or receive other communications without noticeable interruption in the reception of the content stream 150. [0054] The consumer interaction units 144 and 149 can also be configured to receive, process and present secondary content elements that are streamed along with primary media content 111 in the content stream 150. For example, the secondary content elements can include offers for sale, surveys, contests or other information requesting consumer interaction, and the consumer interaction units 144 and 149 can process such information to generate corresponding user interface elements or, if the consumer has responded to a secondary content element, to generate and transmit appropriate communications to the content provider 110 or the interactive program provider 120.

[0055] The consumer devices 140 and 145 can interact with the interactive program provider 120 and the content provider 110 in an integrated manner. For example in integrated messaging implementations, the consumer can send a message without exiting the application running on the device, and subsequently sending a short code, sending the message, and then restarting the previously active application. Instead, the consumer can send the message (with or without a short code) while the original application remains active. Also, the content provider 110 can send live data from within a WAP session while still allowing for interactivity.

[0056] In some implementations, the consumer interactions utilize the Interactive Voice Response (IVR) technology. This technology enables interaction between a caller and a computer via the telephone. Callers can interact with IVR systems by pressing numbers on a telephone keypad or by speaking simple commands to answer the computer's voice prompts. Some embodiments use an

IVR trigger to create a data session or download an application. This allows for another channel for content discovery or consumer selection. The response message from the IVR application can trigger some change or event from within the application. For example, a data session can be interrupted for a phone call and then resume seamlessly. Therefore, the integrated nature of some embodiments can allow a consumer to make a phone call to select an offered item or initiate another action while receiving a video in a content stream or engaging in a chatroom discussion.

[0057] The components in FIG. 1, and in all other Figures of the present application, can be realized, combined and grouped in a large number of ways. A functionality of one element may be performed by another element. Two elements may be combined or integrated into a single unit. For example, the content provider

110 and the media distributor 121 can be an integrated system. Or the consumer interaction server 127 and the consumer interaction manager 117 can be integrated into a single system. The functions of any one element can be performed by more than one physical unit, which can be separated by substantial physical distances. For example the stream servers 123 and the communication interaction servers 127 can be set up at distant locations, even though both are part of interactive program provider 120. The functions can be performed partially by software and partially by hardware and any combination of software and hardware.

[0058] FIG. IB illustrates an implementation of information exchange in the interactive digital media streaming system 100, shown in FIG. IA. In particular,

FIG. IB illustrates information exchange between the content provider 110 and the consumer devices 140 and 145.

[0059] The content provider 110 generates edited stream content 170. The edited stream content includes the primary media content 111 and the secondary content 112. For example, the content provider 110 can use the stream editor 115 (FIG. IA) to generate the edited stream content 170.

[0060] The content provider 110 transmits the edited stream content 170 to the consumer devices 140 and 145. For example, the content provider 110 can provide the edited stream content 170 to the interactive program provider 120 (FIG. IA) that generates the content stream 150 (FIG. IA) from the edited stream content

170, and streams the content stream 150 (FIG. IA) through the communication network 130 (FIG. IA) to the consumer devices 140 and 145. [0061] Each of the consumer devices 140 and 145 includes a respective tool, the consumer interaction unit 144 or 149 (FIG. IA), that allows their respective user, i.e., the consumer, to send consumer feedback 180 to the content provider 110. The consumer feedback 1 SO can include direct consumer interactions or automatic reports generated by the consumer devices 140 and 145. For example, the consumers can respond to surveys, participate in contests, or compose and send comments about or in relation to the edited stream content 170 to the content provider 110. Or the consumer devices 140 and 145 can automatically report to the content provider 110 if the user has switched to another program channel.

[0062] In the system 100, the content provider 110 has an integrated tool, the stream editor 115 (FIG. IA), which can present the consumer feedback 180 to one or more operators at the content provider 110, and allow these operators to change the edited stream content 170 in response to the consumer feedback 180. For example, one of the operators, such as a DJ in a radio studio, can respond to a consumer comment, and add both the consumer comment and his or her response to the edited stream content 170 as elements of the secondary content 112. Or, the operator can change the primary media content 111 in the edited stream content 170 if the consumer feedback 180 includes negative comments, or many consumers have switched to another program channel.

[0063] FIG. 2A illustrates an interactive digital radio streaming system

200 according to one aspect of the present invention. The interactive radio streaming system 200 can be implemented using the interactive digital media streaming system 100 (FIG. IA). The interactive radio streaming system 200 is configured to stream digital audio content and additional content along with the audio content to multiple consumers, and to allow the consumers to respond to the received content in real time.

[0064] The interactive radio streaming system 200 includes a radio content provider 210, an interactive radio provider 220, a wireless communication network 230, and multiple consumer devices, such as wireless devices 240 and 245. The radio content provider 210 provides content to the interactive radio provider 220, which forms a content stream 250 from the received content and streams the content stream 250 through the wireless communication network 230 to the wireless devices 240 and 245. The wireless devices 240 and 245 receive the streamed content and present it to their respective users, i.e., the consumers. The consumers can also use their respective wireless devices 240 and 245 to interact with the interactive radio provider 220 and the radio content provider 210 in response to the received content. For example, the wireless devices 240 and 245 can establish respective interactions to communicate messages 262 and 267 and orders 263 and 268 through the wireless network 130 back to the interactive radio provider 220.

The interactive radio provider 220 can process the information received from the consumers and transmit the processed information to the radio content provider 210, or to one or more other service providers (not shown).

[0065] The radio content provider 210 provides audio content 211 and secondary content 212 and includes a radio stream editor 215 to monitor the audio content 21 1 and to edit the secondary content 212 for streaming along with the audio content 211. The radio stream editor 215 can also be configured to review or edit the audio content 211, which includes radio programs for one or more program channels.

[0066] The audio content 211 can include music records, pre-recorded radio shows or advertisements. The audio content 211 can also be generated "live" using the radio content provider 210. For example, radio content provider 210 can include a radio station or a production unit of a radio personality, and the audio content 21 1 can include a radio talk show or music program produced by the radio station or the production unit. The radio talk show or music program can be streamed "live" or recorded for later streaming.

[0067] The secondary content 212 includes content elements that can be displayed using the wireless devices 240 and 245 while their respective consumers listen to the audio content 211. In one implementation, the secondary content 212 includes visual content 213 and textual content 214. The visual content 213 can include images, graphics, animations, or videos, and the textual content 214 can include text messages from consumers or from a DJ, announcements, advertisements, or other information in textual form.

[0068] For a radio show, the visual content 213 can include an image or a

"lite video" representing a guest of the radio show. Lite video is a video of short duration (e.g. 15 sec), with reduced resolution or lower refresh rate. The lite video can be encoded using M-JPEG, MPEG, MPEG4, or any mobile compliant video format, such as those developed by the 3rd Generation Partnership Project (3 GPP).

[0069] The lite video can include a video clip of the guest, or shots about the activity in the studio. The visual content 213 can also include still pictures of the guest or the studio activity. Or the visual content 213 can include images, graphics or animation to initiate a survey or contest or to represent the results of such surveys and contests. The images can have any recognized format, such as JPEG, PNG, TIFF, GIF, PCD, EPS, WMF, or bitmap formats. By streaming such visual content elements along with the audio content 211₅ the visual content 213 can enhance the consumer's experience during the talk show, making it more attractive to the listeners. If elements of the visual content 213 are streamed along with the audio content 211, the interactive radio system 200 may provide a "Smart Mobile Casting" experience.

[0070] For the radio show, the textual content 214 can include text messages, such as Instant Messages (IM) or Short Message Service (SMS) messages, received from the users of the wireless devices 240 and 245. A host of the radio show can also add text messages to the textual content 214. For example, the host can make announcements or respond to or comment on the consumers' messages.

The textual content can also initiate a survey or contest or to represent the results of such surveys and contests. Thus, a true interaction can be initiated and facilitated between the consumers and the talk show host. [0071] The secondary content 212 can also include commercial elements (also called commercial components), both in the form of the visual content 213 or the textual content 214. For example, the secondary content can include advertisements, promotions and offers for sale. Such commercial elements can be streamed along with the audio content 211 to increase the probability that the consumers would respond. For example, an artist's image, ringtone, or video can be offered for sale in the secondary content 212 that is streamed along, with the audio content 211 playing that artist's music.

[0072] The radio stream editor 215 includes a secondary content selector 216, a consumer interaction manager 217, and a user interface 218. The secondary content selector 216 selects elements of the secondary content 212 to be streamed along with the audio content 21 1, and the consumer interaction manager 217 manages interaction with the wireless devices 240 and 245. The user interface 218 allows an operator to monitor and edit content to be streamed, and to manage the secondary content selector 216 and the consumer interaction manager 217.

[0073] The secondary content selector 216 can select elements of the secondary content 212 based on user input received from the user interface 218, or automatically according to a predetermined schedule or predetermined rules. Thus, the operator can use the secondary content selector 216 to control the selection and timing of the secondary content elements that are streamed along with the audio content 211.

[0074] The consumer interaction manager 217 receives information communicated by the wireless devices 240 and 245 while receiving the content stream 250. The consumer interaction manager 217 includes a chatroom manager 217-1 and a survey manager 217-2. The chatroom manager 217-1 receives and processes text messages received from the wireless devices 240 and 245. For example, the chatroom manager 217-1 can format the received consumer information for presentation in the user interface 218. Or the chatroom manager 217-1 can parse consumer messages and select or rank the interesting ones for display by the user interface 218. In one implementation, the chatroom manager 217-1 is configured to provide elements of the secondary textual content 214.

[0075] The survey manager 217-2 manages interactions related to contest responses or surveys, such as consumer votes. Optionally, the survey manager 217- 2 can also Teceive and process consumers' responses to commercial elements, such as offers for sale, advertisements or promotions that have been streamed as secondary content elements along with the audio content 211. In one implementation, the survey manager 217-2 determines and records survey or contest results, individual or overall responses to advertisements or promotions, or other statistical features. The survey manager 217-2 can also format the survey results as elements for streaming in the secondary content 212 or for presentation by the user interface 218.

[0076] The user interface 218 displays information received from the secondary content selector 216 and the consumer interaction manager 217, and receives user input from an operator of the radio stream editor 215 to control the secondary content selector 216 and the consumer interaction manager 217.

[0077] The interactive radio provider 220 includes a media distributor 221 and a consumer interaction service provider 225. The media distributor 221 streams the content stream 250 through the wireless communication network 230 to the wireless devices 240 and 245, and the consumer interaction service provider 225 processes the messages 262 and 267 and orders 263 and 268 received through the wireless network 230 from the wireless devices 240 and 245. The media distributor 221 and the consumer interaction service provider 225 can share or exchange information.

[0078] The media distributor 221 receives the audio content 211 and the secondary content 212 from the radio content provider 210. The media distributor 221 includes a stream server 223 that composes the content stream 250 from the received content. For example, the audio content 211 can be streamed using an audio codec, such as QCELP, AMR, MP3, AAC, AC3, or equivalents that are supported by the wireless devices 240 and 245. Thus, the stream server 223 streams the audio content 211 and the secondary content 212 through the wireless communication network 230 to the wireless devices 240 and 245.

[0079] The consumer interaction service provider 225 receives and replies to the messages 262 and 267 and orders 263 and 268 initiated at the wireless devices 240 and 245. The consumer interaction provider 225 can also record, process, or forward the messages 262 and 267 and orders 263 and 268. The consumer interaction service provider 225 includes one or more message servers 228 and one or more commercial servers 229, The message servers 228 process and forward the messages 262 and 267 and, if necessary, generate appropriate responses to the wireless devices 240 and 245. For example, the message servers 228 can record, sort, or redirect the messages 262 and 267. The message servers 227 can also send responses to the messages 262 and 267, for example, by sending acknowledgments or text messages addressed to individual consumer devices.

[0080] The commercial servers 229 can receive, process, and respond to the orders 263 and 268 that are commerce related communications received from the wireless devices 240 and 245. For example, the orders 263 and 268 can include orders to buy digital content or other goods in response to secondary content 212 streamed along with the audio content 211. The commercial servers 229 can process the orders 263 and 268 and, if required, request financial transaction or other information from the wireless devices 240 and 245. The commercial servers 229 can also include one or more digital publication servers that can transmit the ordered digital content to the consumer devices 240 and 245 through the wireless network 230. Optionally, the commercial servers 229 can also contact order- fulfillment or other servers (not shown) to complete transaction required to fulfill the orders 263 and 268.

[0081] The wireless communication network 230 transmits the content stream 250 to the wireless devices 240 and 245, and the messages 262 and 267 and orders 263 and 268 to the interactive radio provider 220. For each of the wireless devices 240 and 245, the wireless communication network 230 can use the same or different communication channels to transmit the content stream 250 and the respective messages 262 or 267 and orders 263 or 268. For telephonic wireless devices having both voice and data channels, the data channels can be used by the content stream 250 and the messages 262 and 267 and orders 263 and 268. The wireless communication network 230 can include any wireless networks, such as WiMAX, WiFi, or cellular wireless networks, and can use any appropriate protocol to transmit the content stream 250 or the messages 262 and 267 and orders 263 and 268. For example, the content stream 250 or the messages 262 and 267 and orders

263 and 268 can be transmitted to mobile phones or PDAs using wireless application protocol (WAP). Furthermore, the wireless communication network 230 can be configured to transmit the content stream 250 to a large number of wireless devices, including the wireless devices 240 and 245, using broadcast, multicast or unicast data packets. The. wireless communication network 230 can also be connected to other networks, such as the Internet, wide area networks (WANs) or local area networks (LANs), cable networks, or wired telecommunication networks. Such networks can also participate, at least in part, in the transmission of the content stream 250 or the messages 262 and 267 and orders 263 and 268.

[0082] The wireless devices 240 and 245 are wireless digital devices configured to receive the content stream 250 and to communicate through the wireless communication network 230. For example, the wireless devices 240 and 245 can include portable digital radio devices, laptop computers or handheld devices, such as palmtops, cell phones, smartphones, or personal digital assistants (PDAs).

[0083] The wireless devices 240 and 245 include radio stream receivers

242 and 247, and consumer interaction units 244 and 249, respectively. Each of the radio stream receivers 242 and 247 is configured to receive and play the audio content 21 1 in the content stream 250. The consumer interaction units 244 and 249 are configured to receive user input from the respective consumer and to transmit the corresponding messages 262 and 267 or orders 263 and 268 to the interactive radio provider 220 through the wireless communication network 230. The consumer interaction units 244 and 249 can also be configured to receive and process communication, such as acknowledgements or requests for information from the interactive radio provider 220. The consumer interaction units 244 and 249 can use the same or a different communication channel to transmit the messages 262 and 267 or orders 263 and 268 than the communication channel through which the content stream 250 is received. In one implementation, the consumer interaction units 244 and 249 can transmit the consumer communications or receive other communications without noticeable interruption in the reception of the content stream 250.

[0084] The consumer interaction units 244 and 249 can also be configured to receive and process secondary content elements that are streamed along with the audio content 211 in the content stream 250. For example, the secondary content elements can include elements of the visual or textual contents 213 and 214, offers for sale, surveys, contests or other information requesting consumer interaction, and the consumer interaction units 244 and 249 can process such information to generate corresponding user interface elements or, if a corresponding user input is received from the consumer, to generate and transmit the appropriate messages 262 and 267 or orders 263 and 268 to the interactive radio provider 220. For example, the interaction units 244 and 249 can include a display screen to display the received elements of the visual or textual contents 213 and 214. The interaction units 244 and 249 can also be configured to allow split-screen applications to present multiple elements of the received secondary content 212 on the same screen. Thus, elements can be displayed both from the visual and textual contents 213 and 214. For example, the screen can display a lite video and text messages from the chatroom, a lite video and offers to sell, a photo and offers to sell. The interaction units 244 and 249 can also be configured to generate one or more SMS or pSMS for voting, contests, or m-commerce sales.

[0085J FIG. 2B illustrates an implementation of information exchange in the interactive digital media streaming system 200, shown in FIG. 2A. In particular, FIG. 2B illustrates information exchange between the radio content provider 210, the commercial servers 229, and the wireless devices 240 and 245.

[0086] The radio content provider 210 generates edited stream content 270 that includes the audio content 211 and the secondary content 212. For example, the radio content provider 210 can use the stream editor 215 (FIG. 2A) to generate the edited stream content 270.

[0087] The radio content provider 210 transmits the edited stream content 270 to the wireless devices 240 and 245. For example, the radio content provider 210 can provide the edited stream content 270 to the interactive radio provider 220 (FIG. 2A) that generates the content stream 250 (FIG. 2A) from the edited stream content 270, and streams the content stream 250 (FIG. 2A) through the wireless communication network 230 (FIG. 2A) to the wireless devices 240 and 245.

[0088] Each of the wireless devices 240 and 245 includes a respective tool, the consumer interaction unit 244 or 249 (FIG. 2A), that allows their respective user, i.e., the respective consumer, to generate consumer feedback 280. The consumer feedback 280 can include messages sent by the consumers to the radio content provider 210 about or in relation to the edited stream content 270. The consumer feedback 280 can also include automatic reports generated by the wireless devices 240 and 245. For example, the wireless devices 240 and 245 can automatically report to the radio content provider 210 if the user has switched to another radio program channel.

[0089] In the system 200, the content provider 210 has a tool, the stream editor 215 (FIG. 2A), which can present the consumer feedback 280 to one or more operators at the radio content provider 210, and allow these operators to change the edited stream content 270 in response to the consumer feedback 280. For example, one of the operators can be a DJ in a radio studio, who can respond to a consumer comment, and add the consumer comment or the DJ' s response to the edited stream content 270 as elements of the secondary content 212. Or, the DJ can change the audio content 211 in the edited stream content 270, for example, if the consumer feedback 280 includes negative comments from the consumers or a report indicates that many consumers have switched to another radio program channel.

[0090] In addition to sending consumer feedback messages to the radio content provider 210, the consumers can use their respective wireless devices 240 and 245 to send orders, including buying orders or other commerce related messages, to the commercial servers 229. The commercial servers 229 can receive, process, and respond to the received orders. Thus, the consumers can buy digital content or other goods in response to the secondary content 212 that has been streamed along with the audio content 211. The commercial servers 229 can also include one or more digital publication servers that can transmit the ordered digital content to the wireless devices 240 and 245 through the wireless network 230 (FIG. 2A). Optionally, the commercial servers 229 can also contact order-fulfillment or other servers to complete transactions that are required to fulfill the orders 263 and 268.

[0091] The radio content provider 210 and the commercial servers 229 can exchange information with each other. For example, the commercial servers 229 can send the radio content provider 210 reports about the commercial activity of the consumers. Or the radio content provider 210 can provide the digital media that is published by the commercial servers 229.

[0092] FIG. 3 illustrates an exemplary secondary content 300 for broadcasting along with primary media content in an interactive digital media streaming system, such as the system 100 (FIG. IA) or the system 200 (FIG. 2A). In particular, the secondary content 300 can be used to implement the secondary content 112 (FIG. IA) or the secondary content 212 (FIG. 2A). The exemplary secondary content 300 includes studio content 310, commercial elements 320, surveys 330, contests 340, and text messages 350.

[0093] The studio content 310 includes information related to activity in a studio that is maintained by a content provider to produce primary media content. In the particular example, the studio content 310 includes guest photo/video elements 312 and studio activity elements 314. The guest photo/video elements 312 can include still-image or video shots of one or more guests' activity in the studio, and the studio activity elements 314 can include still-image or video shots of general activity in the studio. For example, the studio activity elements can include shots of a show host, such as shots showing a DJ in a radio studio.

[0094] The commercial elements 320 relate to commercial activities, such as selling or buying, promoting, or advertising commercial products. Accordingly, the commercial elements 320 can include promotions 322, advertisements 324, and offers for sale 326 in the form of text or visual content, such as images, animations or videos.

[0095] The surveys 330 and the contests 340 typically require consumer participation that can provide valuable information for subsequent targeted advertisements or offers for sale. The surveys 330 and the contest 340 can include text or visual content elements, such as images, animation or video.

[0096] The text messages 350 can include chatroom activity, such as text messages from consumers or from a DJ. The text messages 350 can also include announcements from the content provider. For example, the announcements can announce programming information, such as guest lists, program schedules or future or parallel programming.

[0097] FIG. 4 illustrates commercial servers 400 that can be used in an interactive digital media streaming system, such as the system 100 (FIG. IA) or the system 200 (FIG. 2A). In particular, the commercial servers 400 can be used to implement one or more of the consumer interaction servers 127 (FIG. IA) or the commercial servers 229 (FIG. 2A).

[0098] The commercial servers 400 can receive, process, and respond to commerce related communications, such as orders to buy digital content or other goods, that are initiated by consumers in response to secondary content streamed along with primary media content in the interactive digital media streaming system.

[0099] The commercial servers 400 include a billing module 410 to process the received orders and, if required, request financial transaction or other information, for example, from other servers or the consumer device from which the order has been initiated.

[00100] The commercial servers 400 also include a mobile content publishing engine 420. Upon receiving an authorization from the billing module 410, the publishing engine 420 can transmit the ordered digital content to mobile consumer devices. In particular, the publishing engine 420 can provide songs 421, ringtones 422, wallpapers or screensavers 423, digital games 424, and other digital applications 425.

[00101] FIG. 5 illustrates a method 500 for establishing interaction between content providers and consumers. The method 500 can be performed by a system that includes a content provider, such as the content provider 110 (FIG. IA) or the content provider 210 (FIG. 2A) in the interactive digital media streaming system 100 (FIG. IA) or 200 (FIG. 2A), respectively.

[00102] The system provides primary media content and secondary content to be streamed through a communication channel or network to multiple consumer devices (step 501). The primary media content includes media programs of primary interest that are streamed to the consumer devices and presented to their respective users. The secondary content is streamed along with the primary media content, and includes content to be presented to the consumers in addition to the primary media content. For example, the primary media content can include radio or television programs, and the secondary content can include text, images or videos to be displayed while the consumer listens to a radio program or watches a television program. The primary media content and the secondary content are transmitted using a communication network, such as a wired or wireless network. [00103] The system receives communication initiated at a consumer device and transmitted utilizing the same communication channel or network through which the primary media content and the secondary content has been received (step 502). The system processes the received communication to modify the primary media content (step 503), and returns to step 501. Thus, the system can initiate and establish real time interaction between the content provider and the consumers receiving the streamed content.

[00104] FIG. 6 illustrates a method 600 for selecting secondary content to be streamed with primary media content to multiple consumer devices. The method 600 can be performed by a system that includes a content provider, such as the content provider 110 (FIG. IA) or the content provider 210 (FIG. 2A) in the interactive digital media streaming system 100 (FIG. IA) or 200 (FIG. 2A), respectively.

[00105] The system organizes secondary content directed to consumer devices (step 601). For example, the system can retrieve secondary content elements from a data base and establish a timed sequence for streaming the retrieved secondary content elements according to a predetermined schedule or predetermined rules. In one implementation, the system uses an artificial intelligence device to organize the secondary content elements. The artificial intelligence device can retrieve and organize secondary content elements according to predetermined rules or other schedules such as artists' appearances or any other criteria. In operation, the artificial intelligence device can schedule and offer the secondary content elements as candidates for streaming..

[00106] The system streams primary media content directed to consumer devices (step 602). The system also streams the organized secondary content along with the primary media content (step 603). The system determines whether the secondary content should be changed or other secondary content should be added (decision 604). For example, the system can analyze the primary media content and request a change or an addition. In other cases, a system operator, such as a DJ, reviews the secondary content elements scheduled or offered by the artificial intelligence device, and provides user input to select, alter, delete or add elements to the secondary content.

[00107] If no change is required ("No" branch of decision 604), the system returns to streaming primary media content (step 602). If the organized secondary content elements should be changed or new elements should be added

("Yes" branch of decision 604), the system selects secondary content elements to be changed or added (step 605), and reorganizes the secondary content according to the selection (step 601). For example, the system can select and reorganize the secondary content elements based on user input.

[00108] FIG. 7 illustrates a method 700 for establishing interaction between content providers and consumers. The method 700 can be performed by a system that includes a content provider, such as the content provider 110 (FIG. IA) or the content provider 210 (FIG. 2A) in the interactive digital media streaming system 100 (FIG. IA) or 200 (FIG. 2A), respectively.

[00109] The system monitors a stream of primary media content directed to consumer devices (step 701), and receives user input from an operator of the content provider (step 702). The received user input selects secondary content to be streamed along with the primary media content to consumer devices.

[00110] The system also receives consumer communication (step 703), where the consumer communication has been initiated at a consumer device that has received the streamed primary media content and the secondary content streamed along with the primary media content.

[00111] The system displays information related to the received consumer communication (step 704). If a system operator decides, based on the displayed information, that the secondary content should be changed, the operator can enter user input into the system. Thus, the system receives user input from the operator selecting new secondary content to be streamed along with the primary media content to the consumer devices (step 705). Thus, the system can initiate and establish real time interaction between the content provider and the consumers receiving the content.

[00112] FIGS. 8A and 8B illustrate exemplary screen shots 800 and 850, respectively. The screen shots 800 and 850 can be generated by a user interface in a stream editor for an interactive digital media streaming system, where the user interface is configured to select and edit secondary content to be streamed along with primary media content to multiple consumers. In the example illustrated by the screen shots 800 and 850, the primary media content includes digital radio programs streamed to handheld wireless devices 860 and 870, and the secondary content includes textual and visual elements that can be displayed by the handheld wireless devices 860 and 870. In one implementation, the screen shots 800 and 850 are generated by the user interface 118 (FIG. IA) or the user interface 218 (FIG. 2A) in the interactive digital media streaming system 100 (FIG. IA) or 200 (FIG. 2A), respectively.

[00113] In FIG. 8A, the screen shot 800 includes a secondary content organizing panel 810, a secondary content selection panel 820, a secondary content editing panel 830, and a chatroom panel 840. The organizing panel 810 can be used to schedule secondary content elements to be streamed along with the audio content of the radio program. The selection panel 820 can be used to select secondary content elements that can be edited using the editing panel 830 or added to the scheduled content elements in the organizing panel 810. The chatroom panel 840 can be used to review text messages received from consumers and to select or add text messages to be streamed along with the audio content of the radio program.

[00114] The secondary content organizing panel 810 illustrates a sequence of secondary content elements 811-817 that are ordered according to a current schedule for streaming along with the audio content of the radio program. Each of the secondary content elements 811-817 is represented by a respective image so that a human user can easily identify the corresponding content element. In one implementation, the same images are streamed to the consumer devices as well. The selection, order, and riming of the secondary content elements 811-817 can be automatically determined by a preset schedule or according to predetermined rules. In one implementation, the secondary content elements 811-Sl 7 are first selected, ordered, and scheduled by an artificial intelligence device.

[00115] The secondary content organizing panel 810 allows an operator, such as a DJ, to alter the selection, order and timing of the secondary content elements 811-817. For example, the operator can use a cursor 805 to select and "drag and drop" one of the secondary content elements 811-817 to reschedule or remove the selected element. The operator can also add new secondary content elements into the organizing panel 810. The new content elements can be selected using the selection panel 820 or the editing panel 830.

[00116] The secondary content selection panel 820 includes a ringtone selection unit 822, a wall paper selection unit 824, a video selection unit 826, and a survey selection unit- 828. Using the selection units 822, 824, 826 and 828, the operator can select a secondary content element from a set of available ringtones, wallpapers, videos, or surveys, respectively. Optionally, the selected content element can be edited using the editing panel, or directly added into the schedule specified by the organizing panel 810.

[00117] The secondary content editing panel 830 includes an editing window 831 and editing menu items NEW, CHANGE, and ADD 834-836, respectively. The editing window 831 includes a secondary content element 832 that is currently edited. After completing the edits, the operator can "drag and drop" the edited content element 832 to add it to the available content elements illustrated by the selection panel 820, or into the schedule specified by the organizing panel 810.

[00118] The operator can use the editing menu items 834-836 to alter the content element 832 or to select a new content element for editing. In particular, the NEW menu item 834 can be used to select a new secondary content element to be edited. For example, the NEW menu item 834 can be used to access a function that allows the operator to capture a live studio shot. The CHANGE menu item 835 can be used to change the selected content element 832. For example, the operator can change an image representation of the content element 832. The ADD menu item 836 can be used to add text or other elements to the edited content element 832.

[00119] The chatroom panel 840 illustrates text messages received from the consumers listening to the radio program. Thus, the operator can continuously monitor consumer reaction to the current streamed content. The chatroom panel

840 also allows the operator to add his or her own messages. In one implementation, the chatroom activity is streamed along with the radio program in addition to the secondary content scheduled by the organizing panel 810. Alternatively, the operator can add the chatroom activity into the schedule secondary contents specified by the organizing panel 810.

[00120] FIG. 8B illustrates the screen shot 850, which also includes the secondary content organizing panel 810, the secondary content selection panel 820, the secondary content editing panel 830, and the chatroom panel 840.

[00121] In the screen shot 850, the organizing panel 810 includes an ON AIR symbol 818 to indicate that a studio shot is currently streamed along with the radio program.

[00122] Furthermore, the editing panel 830 includes the studio shot as the secondary content element to be edited, and the studio shot is accompanied by an offer 833 for sale. The editing panel 830 also includes a new layout for menu items that are related to editing the studio shot. In particular, the NEW menu item 834 has a different presentation, and an EDIT menu item 837 is provided to access corresponding editing functions. [00123] FIG. 9 illustrates an implementation of an interactive operation 900 of a media distributor.

[00124] In step 901 the media distributor receives primary media content and secondary content from a content provider.

[00125] In step 902 the media distributor forms a content stream from the primary media content and the secondary content in a stream server and streams the content stream through a communication network to consumer devices.

[00126] In step 903 the media distributor receives a communication which was initiated at a consumer device in response to the content stream. In some implementations the communication is received from a network, in others, from a consumer interaction service provider.

[00127] In step 904 the media distributor transmits the received communication to the content provider, or to the consumer interaction service provider. The media distributor and the consumer interaction service provider can share or exchange information. Thus, the media distributor can receive consumer information from the consumer interaction service provider, and the consumer interaction service provider can receive information about the content stream.

[00128] Steps 901-904 can be performed repeatedly in the course of the interactive operation, as represented by step 905.

[00129] FIG. 10 illustrates an implementation of an interactive operation

1000 of a consumer interaction service provider.

[00130] In step 1001 the consumer interaction service provider contributes to or monitors a content stream of primary media content and secondary content directed to consumer devices by a content provider arid a media distributor through a communication network. [00131] In step 1002 the consumer interaction service provider receives a communication initiated at consumer devices in response to the content stream, from the communication network.

[00132] In step 1003 the consumer interaction service provider processes the received communication, partially or fully.

[00133] The consumer interaction provider can record, process, or forward the consumer communications. For example, the consumer interaction service provider can determine and record one or more features of the received consumer communications. The determined and recorded features can include survey or contest results, individual or overall responses to advertisements or promotions, or other statistical features of the consumer communications. These features include how long a consumer takes to respond to a program content, what styles of the content the consumer responded, how many consumers are listening at any given time, how long do they listen to a program, etc.

[00134] The consumer interaction service provider can also create, manage and update a consumer data base based upon the received consumer communications. The database can be organized according to any targeted consumer characteristics. It can be organized on an individual level, recording the listening and activity patterns of the consumers individually, allowing program selectors to personalize subsequent advertisements. Or it can be based on geographic area (in relation to area codes). Or it can be organized in cooperation with databases of the network, where additional consumer information is available.

[00135] In step 1004 the consumer interaction service provider transmits the processed communication to the content provider, to the media distributor, or to other service providers, such as order fulfillment services.

[00136] Steps 1001-1004 can be performed repeatedly in the course of the interactive operation, as represented by step 1005. [00137] FIG. 11 illustrates an implementation of an interactive operation 1100 of a communication network.

[00138] In step 1101 the network streams a content stream created from a primary media content and a secondary content from a media distributor directed to consumer devices.

[00139] For example, the communication network can include public or private, wired or wireless networks that cover many consumer devices or a large geographical area. Thus, the communication network can include, at least in part, the Internet, wide area networks (WANs) or local area networks (LANs), cable networks, wired or wireless telephone networks. The network can include any combinations of the above systems, such as a voice over internet protocols (VOIP), which combine telephone networks and the Internet. The communication network can transmit the content stream using broadcast, multicast or unicast directed to each of the consumer devices.

[00140] In some implementations, the primary media content can be a radio show, which is streamed on the voice channel or band, whereas the secondary content is a visual image of the guest of the radio show, or a text message related to the guest, or the transcript of the show, or a promotion, or a contest. Any of these secondary contents can be streamed over a data channel, or sideband, of the network. Reserving a side band or data channel for the secondary content allows an easier organization and management of the interactive operations of the system.

[00141] In step 1102 the network receives communication initiated at a consumer device in response to the content stream.

[00142] In step 1103 the network transmits the received communication to the media distributor or to a consumer interaction service provider, to be transmitted to the content provider. This step exemplifies that in this method the consumer can interact with the content provider. [00143 J Steps 1101-1103 can be performed repeatedly in the course of the interactive operation, as represented by step 1104.

[00144] FIG. 12 illustrates an implementation of an interactive operation

1200 of a consumer device. The consumer device can be any one of a wide variety of devices. It can be a cell phone, a personal digital assistant (PDA), any portable communication device, such as a laptop, a pocket PC, a portable radio, a television device, and any variations, capable of receiving digital information and transmitting information in return. In step 1201 the consumer device receives a content stream, assembled from a primary media content and a secondary content, from a communication network.

[00145] In one example, the consumer device receives the content stream at a stream receiver. The consumer device may contain a consumer interaction unit, which displays a representation of the secondary content of the content stream.

[00146] The streamed content can be a wide variety of information. The primary media content can be a talk show or a music program broadcast by a radio studio. It can have a live host, such as a talk show host or a disc jockey. Or it can be a program with a broadcast manager, who organizes, edits or manages the broadcast but does not provide audible input.

[00147] The secondary content can be any one of a very wide variety of information. It can be a promotion, a representation of the text entries of a chatroom, information regarding the guest of the show, the radio station, or an upcoming program. It can be an image of the guest, an image related to the guest, a low resolution, low refresh rate video ("lite-video") related to the guest (such a music video), a lite-video of a studio activity, a contest, a survey, a community announcement or any analogs.

[00148] In step 1202 the consumer device receives user input from a consumer in response to the content stream. The consumer input can again be a vety wide variety of inputs, enabled by the applications available on the consumer device. For example, a customer interaction unit of the customer device can provide an interactive interface involving a display of the customer device. The interface can involve selectable icons, which can be selected by keys of the device, identified on the screen. The interface can also include a chatroom application. For this application the consumer enters the input by the letter keys of a keyboard. If the consumer device is a laptop, then all known computer input channels are available for the consumer.

[00149] The consumer interface is intuitive and flowing. It includes scrolling interactive graphics and text, links to mobile commerce and embedded video and audio clips. Some implementations allow for blogging from the consumer device, managing subscriptions and coordinated SMS messaging and alerts. The applications make it easy to choose from hundreds of radio stations, images and videos. The applications also have a flexible design: they are capable of supporting various business models, including subscription sales, supported by "on- deck" carrier distribution, or direct sales to the consumers, advertising, and sponsorship utilizing both on and off deck billing solutions.

[00150] Some applications are developed for Java 2 Micro Edition (J2ME) enabled devices. Some applications are developed on the Binary Runtime Environment for Wireless (BREW) platform. BREW is ideally suited to creating powerful applications on memory/footprint-constrained devices. One of the ways BREW is able to do this is by working with truly compiled code that has been written in languages such as C and C++. The applications feature a fully graphical interface, and include one or more of the following capabilities:

- Streaming audio;

- Light video presentation, which involves 15 second clips in motion JPEG format;

- Interactive chat clients;

- Scrolling interactive graphics and text;

- Links to mobile commerce; - Personalization features;

- Visual radio;

- Interactive radio platforms for contests, promotions and polling;

- Interactive customer relationship management (CRM) systems; - Promotional Messaging and coupon systems;

- On phone subscription management for premium channel pay-per-view (PPV) that can support web community boards;

- On deck and Web mobile content sales with server side distribution systems;

- Porting capabilities to other desktop and mobile devices.

[00151] The server infrastructure, implementations of which include the consumer interaction servers 127 within the consumer interaction service provider 125, and the consumer interaction manager 117 within the stream editor 115, all in FIG. IA and 2A, includes the following functionalities:

- Ability to deliver the above described contents to the consumer devices; - Manage the consumer personalization of client applications, in some cases over the phone, in others over the Internet;

- Gather, process, organize and report the statistics of relevant elements of channel usage, and profiling of consumer behavior patterns.

[00152] In step 1203 the consumer device generates a communication in response to the user input. In an example, the communication is generated in a consumer interaction unit. The communication can be a direct communication, as entered by the customer. Or the communication can be an indirect communication, e.g. a report regarding the consumer. Examples include data regarding the listening habits of the consumer, the response time of the consumer, an indication that the consumer tuned in or out from the radio program.

[00153] In step 1204 the consumer device transmits the generated communication through the same communication network, towards a content provider, or a media distributor, or a consumer interaction server, which can be part of an interactive program provider.

[00154] Steps 1201-1204 can be performed repeatedly in the course of the interactive operation, as represented by step 1205.

[00155] The implementations of these interactive methods do not interfere with the primary function of the consumer device. For example, if the consumer device is a cell phone, then the phone continues to operate as a cell phone (receive phone calls etc.) while also performing the above implementations.

[00156] FIGs. 13A-D illustrate various features and functionalities of consumer devices. In particular, a feature of several implementations of the interactive method of FIGs. 5-13 is that the primary media content can be reflective of the consumer communication, since the consumer communication is transmitted, either directly, or after some processing, all the way back to the content provider.

[00157] FIG. 13 A illustrates an implementation, where the primary content is a talk show hosted by a radio personality. Here the primary content is the digital audio stream or the radio program. The secondary content maybe an instant photo of the host, taken in the studio as shown in FIG. 13 A. Or it can be a previously shot photo of the host. Or a photo of the studio. Or a lite-video of the studio activity.

[00158] FIG. 13B illustrates a lite-video, selected by the host or a producer of the show. In addition, the secondary content may include a display of entries of a chatroom, as shown in FIGs. 13A-C. The secondary content can also include a promotional message, such as the time of the concert of a guest, or the title of her book; or information on a contest, such as alerting the consumers for a competition to get a ticket for the concert of the guest; or an instant messaging (IM) application, inviting consumers to communicate with the guest.

[00159] In any of the above implementations, the radio personalities (the guest and the host) have the opportunity to interact with the customers. E.g. in the implementation of FIG. 13 A the secondary content is a photo of the host (Rush Limbaugh), and the latest entries into the program-related chatroom. FIG. 13B illustrates that the radio personality (Rush Limbaugh) himself can send an entry to the chatroom ("Rush").

[00160] FIG. 13C illustrates a related implementation, where the host of a sports show (Jim Rome) displays a photo of a baseball event and related sports data, as one of the secondary contents, and in addition chatroom entries are visible in the lower portion of the display, as another secondary content. In this chatroom the consumers can interact with the host, as the host can respond to the consumer's comments (see chatroom entry "Rome"). The host's response gives rise to an edited content stream.

[00161] The host and the consumers can also interact through a short message service (SMS) and pSMS systems. Such interactive systems allow for voting implementations, surveys, and contests. In voting systems the radio personality poses questions and the consumers respond through chatrooms, instant messaging or SMS. A consumer interaction services provider can process, summarize and tabulate the results of the vote and relay the processes summary to the radio personality. In surveys, similarly, the consumers can respond to the host's questions, which are posed either in the primary media content, e.g. live on the radio show, or in the secondary content, e.g. in the text box.

[00162] FIG. 13D illustrates another implementation. Here the secondary content includes consumer choices, such as prompters to access prerecorded programs ("classics") or shows. The secondary content also includes consumer interaction display elements, in the present case selectable icons. These selectable icons allow the consumer to indicate to the content provider their intent to access a particular show, pre-recorded or live. In some implementation a selectable icon is "Play". This implementation is a type of "on-demand" application. By "pressing" (activating) the icon, the consumer can access the indicated program. In response, the content provider can broadcast or stream the requested program. During this broadcast or stream, even if the program was pre-recorded and thus the broadcast does not involve a live host, a program manager or producer can generate secondary content, e.g. in the form of photos of the artist or talk show host, or any number of advertisements. If the consumer joins a pre-scheduled re-broadcast, the consumer can join a chatroom and exchange messages with other consumers, listening to the same program.

[00163] FIG. 13E is an implementation where the interaction between the consumer and the content provider takes the form or "show alerts". The secondary content alerts the listener that the show time of a desired show is coming up. In some implementation the reminder or alert can take the form of a phone call, or the on-board processor of the consumer device records the show time during an earlier interaction with the content provider and alerts the consumer when the actual show time approaches. The alerts can take many forms: traffic alerts, alert to buy tickets for desired shows, sport-related alerts, alerts related to weather forecast or changes.

[00164] A feature of some of the above implementations is that radio programs, which were previously available only in geographically restricted areas become available to customers in a much larger region with service for cell phones.

[00165] FIGs. 14-20 illustrate an implementation of a commercial operation of the main elements of an interactive digital media streaming system. In this implementation the content provider can be the content provider 210 of FIG. 2 A or analogs, the primary media content can be the primary media content 211 or analogs, the secondary content can be the secondary content 212 or analogs, the media distributor can be media distributor 221 or analogs, the consumer interaction service provider can be the consumer interaction service provider 225 or analogs, the communication network can be the communication network 230 or analogs, the consumer devices can be the consumer devices 240 and 245 or analogs, the content stream can be the content stream 250 or analogs, the communications can be the communications 260 or 265 or analogs. In some implementations media distributor 221 and consumer interaction service provider 225 are part of interactive program provider 220. In some implementations consumer interaction service provider 225 includes message servers and commercial servers.

[00166] In some implementations the above elements can be the corresponding elements in FIG 1 or equivalents. Furthermore, in some implementations the secondary content can be the secondary content in FIG. 3. In some implementations the commercial server of FIG. 4 can be part of the consumer interaction service provider. In some implementations incorporate any combination of the above elements.

[00167] FIG. 14 illustrates a commercial operation 1400 of a content provider.

[00168] In step 1401 the content provider streams a primary media content directed to consumer devices through a media distributor.

[00169] In step 1402 the content provider streams a commercial component along with the stream of the primary media content directed to consumer devices.

[00170] In step 1403 the content provider receives a communication initiated at a consumer device in response to the commercial component.

[00171] In step 1404 the content provider performs a step of the processing of the received communication, or transmits the received communication to a communication processing service.

[00172] Steps 1401-1404 can be performed repeatedly in the course of the interactive operation, as represented by step 1405.

[00173] FIG. 15 illustrates a commercial operation 1500 of a media distributor. [00174] In step 1501 the media distributor streams a primary media content, received from a content provider and directed to consumer devices, through a communication network.

[00175] In step 1502 the media distributor streams a commercial component, directed to consumer devices, along with the primary media content.

[00176] In step 1503 the media distributor receives a communication initiated at a consumer device in response to the commercial component.

[00177] In step 1504 the media distributor performs a step of processing the received communication, or transmits the received communication to a communication processing service.

[00178] Steps 1501-1504 can be performed repeatedly in the course of the interactive operation, as represented by step 1505.

[00179] FIG. 16 illustrates a commercial operation 1600 of a consumer interaction service provider.

[00180] In step 1601 the consumer interaction service provider initiates or contributes to a stream of a commercial component along with a stream of a primary media content, streamed by a content provider and assembled by a media distributor.

[00181] In step 1602 the consumer interaction service provider receives a communication, initiated at a consumer device in response to the commercial component, from a communication network or the media distributor.

[00182] In step 1603 the consumer interaction service provider performs a step of processing the received communication, or transmits the received communication to a communication processing service, or the content provider or the media distributor. [00183] The consumer interaction provider can record, process, or forward the consumer communications. For example, the consumer interaction service provider can determine and record one or more features of the received consumer communications. The determined and recorded features can include survey or contest results, individual or overall responses to advertisements or promotions, or other statistical features of the consumer communications. These features include how long did the consumer take to respond to an advertisement, how many times the consumer makes a transaction during a session, what features of the content the consumer responded to, among others.

[00184] Steps 1601-1603 can be performed repeatedly in the course of the interactive operation, as represented by step 1604.

[00185] FIG. 17 illustrates a commercial operation 1700 of a communication network.

[00186] In step 1701 the communication network streams the primary media content from a media distributor to consumer devices.

[00187] In step 1702 the communication network streams a commercial component to consumer devices along with the primary media content.

[00188] In step 1703 the communication network receives a communication initiated at a consumer device in response to the commercial component.

[00189] In step 1704 the communication network transmits the communication to a consumer interaction server, or to a communication processing service, or to the media distributor.

[00190] Steps 1701-1705 can be performed repeatedly in the course of the interactive operation, as represented by step 1705. [00191] FIG. 18 illustrates a commercial operation 1800 of a consumer device.

[00192] In step 1801 the consumer device receives a stream of a primary media content from a communication network.

[00193] In step 1802 the consumer device receives a commercial component along with the primary media content through a communication network.

[00194] In step 1803 the consumer device receives a user input from a consumer to initiate a commercial transaction.

[00195] In step 1804 the consumer device transmits a communication, representing the commercial transaction, through the communication network.

[00196] Steps 1801-1804 can be performed repeatedly in the course of the interactive operation, as represented by step 1805.

[00197] FIG. 19 illustrates a commercial operation 1900 of a consumer device.

[00198] In step 1901 the consumer device receives a stream of commercial component along with a primary media content through a communication network.

[00199] In step 1902 the consumer device displays a representation of the commercial component and selectable icons related to the commercial component.

[00200] In step 1903 the consumer device receives a consumer selection, input by a consumer using the selectable icons.

[00201] In step 1904 the consumer device generates and transmits a communication representing the consumer selection to the same communication network.

[00202] Steps 1901-1904 can be performed repeatedly in the course of the interactive operation, as represented by step 1905.

[00203] FIGs. 20A-C illustrate various features and functionalities of the commercial operation.

[00204] FIG. 2OA illustrates an implementation where the commercial component of the content stream includes a photo related to a song, which is played as the primary media content. This could be the cover of the album or a promotional photo of the artist. The commercial component further includes offers for sale ("Buy this song", "Buy ringtone") in the form of selectable icons. The consumer can select one of these icons. The consumer device then generates an order to buy message and transmits it through the network to the consumer interaction service provider. The consumer interaction service provider can either process the order to buy itself, or it can forward it to the media distributor or the content provider. The transaction involves delivering the ordered product: in the present implementation the downloading of the ordered song, or the ringtone to the phone. In implementations this can be performed by the consumer interaction service provider, the media distributor, by the content provider, or a separate order fulfillment service. More specifically, at the content provider either the host of the music program or specialized personnel at the radio studio can download the program to a cell phone. In other cases, the order to buy can be forwarded to an online music store, which fulfills the order.

[00205] Besides songs and ringtones, any other digital products can be subject of such commercial transaction. For example, consumers could access games, screensavers, electronic "wallpapers", or any type of applications.

[00206] All of these products can be advertised as part of the secondary content. The advertisements can include interstitial s, banners, ad serving, sponsored presentations, sponsored contesting, sponsored custom applications, audio commercials, even text messaging.

[00207] FIG. 2OB illustrates an implementation involving contests. The host of the primary media content selects as a secondary content an invitation to a contest. Upon some form of payment, the consumer's number is recorded. The payment can be a simple fee for every call, or a credit card payment, or any other electronic form of payment. The contest closes by a system of selection among the consumers, who entered the contest.

[00208] FIG. 2OC illustrates a commercial transaction on a pocket PC type consumer device, sometimes referred to as "Auto PSMS queuing". In step 1 the commercial component includes an image related to a song, the photo of the artist. The commercial component also includes an offer to sell a ring-tone and a consumer-selectable icon ("purchase now"), allowing the consumer to initiate a transaction.

[00209] In step 2, after the consumer inputs an order to buy, the consumer device sends a communication to the consumer interaction service provider. In response, the consumer interaction service provider displays various billing options. These options include billing the cell phone of the consumer, involving a PSMS account, possibly billing through an OBO-pay account, which is an electronic payment service supporting on-line transactions. Other methods of billing can be also utilized, e.g. pay-pal type billings, or pre-paid accounts, or linkage to regular credit card-based systems, or direct access to a bank account of the consumer.

[00210] In step 3 the consumer selects the PSMS system to pay. In this system of payment the consumer previously established an account. Now the consumer can designate or authorize the payment with a short SMS description

("shakira") and the corresponding (address) code. Step 4 illustrates the use of the OBO-pay option, which uses a prepaid account, accessed by typing in a username and password. In step 5 the consumer enters the (address) code in the "to" field, and the product identifier "shakira" into the message field, and then sends the message, effecting the purchase of the ringtone.

[00211] As discussed above, the commercial transactions can be implemented in an integrated manner. Thus, the consumer can pay for a selected product or download without stopping the currently running application, and subsequently carrying out the payment authorization with a separate message using short codes, and then restarting the original application. Instead, the original application can remain active while the payment is effected in real time. The system can be implemented to use one or more billing systems, including a PSMS system or a mobile wallet, which can be tied to a credit card or third party billing system.

[00212] In some implementations, the consumer accesses the above services by subscribing for a monthly fee. To access the service the end user downloads an embodiment of this implementation onto the mobile device or handset.

[00213] The monthly fees can be collected in some embodiments by the provider of the interactive digital service provider. This can include credit card billings or any other financial transaction, involving bank cards, cash cards, bill-me- later arrangements or any equivalents. The consumer can sign up to the service for example through the Internet, or by directly contacting the phone service provider. In some embodiments the wireless carrier company adds the charges to the monthly bill of the end user.

[00214] The subscription can be on various levels. There can be a base subscription product, which provides access to a number of radio stations (of any genre and market). These radio stations can be chosen from a wider selection. The choice can be modified at any time during the subscription period. In other embodiments a wider selection of radio stations is available.

[00215] Some embodiments may include premium products for added cost. These could include radio stations broadcasting the programs of popular, nationally recognized radio personalities, such as talk show hosts and disc jockeys. Any combination of base products and premium products can be provided as well.

[00216] An aspect of some embodiments is that the end user can purchase the digital goods while listening to the radio program on the handset. This synchronous presentation of the content and the offers to sell constitute a "contextual commerce", enhancing the potential for cross-sales.

[00217] The term "m-commerce" refers to mobile commerce, i.e. commercial transactions involving mobile electronic devices. Examples of "digital goods" include ring tones, screen savers, games, graphics, any applications, even

CDs and T-shirts, concert tickets: any goods or services which can be purchased over mobile devices.

[00218] In m-commerce embodiments the sales can be individual, non- subscription based. Of course combinations of the two methods can also be implemented, where a monthly subscription enables individual purchases in the corresponding period. This m-commerce application bears resemblance to the iTunes business model.

[00219] Some embodiments include games which involve multiple players interacting. These games may require an action from an end user when away from non-mobile devices, thus providing a useful service. Other embodiments include mobile gaming, e.g. poker, slot machine equivalents, or any other casino type applications.

[00220] In any of the embodiments the end user's selection can be transmitted by regular text messaging, or its many variants, such as SMS and premium SMS (pSMS). pSMS is a carrier billing mechanism and a wireless opt-in vehicle for various interactive wireless services. pSMS can be used to charge a wireless user to participate in a vote, a poll or contest. pSMS can also be used to bill for a wireless download.

[00221] The above implementations can be integrated within the application to perform PSMS transactions directly from the application since the application session includes an identifier for the user that allows the system to query carrier SMS gateways for billing approval for charges.

[00222] Any combination of the above embodiments also constitutes further embodiments. For example, during a radio talk show there might be a contest, a survey, or an advertisement streamed to the handset, inviting the end user to make a purchase.

[00223] While various embodiments of the invention have been shown and described for purposes of illustration, it will be apparent to those of ordinary skill in the art that numerous alterations and variations may be made without departing from the scope of the invention or inventive concepts presented herein. For example, any combination of the described implementations and inclusion of their numerous equivalents also belong to the scope of the invention. The described methods, or portions of them, can be implemented in software, hardware, or in a combination of software and hardware. Steps in the described methods can be performed in different order and still provide desirable results. Persons of ordinary skill will appreciate that changes can be made to inputs, factors, combinations of factors, relationships of and between components, and other commercial or industrial techniques, all without departing from the scope of the invention. Also, those of ordinary skill will understand that the various steps, acts, methods, and sub-steps described with respect to alternate embodiments may be rearranged, substituted, or combined with each other and that various method steps and sub-steps described above with respect to alternate embodiments may be rearranged, substituted, or combined with each other, all without departing from the scope of the invention. Thus, the invention is not to be limited except in accordance with the following claims and their equivalents.

Claims

CLAIMSWhat is claimed is:

1. A method for providing a visual radio experience, said method comprising:

streaming digital content from a media distributor directed to an audience comprising at least one consumer device;

wherein said digital content comprises primary media content and secondary content;

receiving communication initiated at said consumer device, where said communication relates to said primary or secondary media content;

relaying said communication to said media distributor;

whereby said media distributor is provided feedback for controllably selecting said primary or secondary content.

2. The method of claim 1, wherein said step of controllably selecting said secondary content comprises:

presenting on a computer-controlled display a plurality of icons representing visual assets which are contextually related to said primary media content;

operating a scheduler for preselectably and dynamically designating a series of said icons to be streamed to said audience;

providing on said display an on-air indicator for identifying one of said icons as corresponding to a visual asset designated for current streaming to said audience;

providing a selector for selectably altering the order of said icons in said series;

providing a selector for adding icons to or removing icons from said series;

providing an editor for creating an icon representing a new visual asset and for editing an icon representing a pre-existing visual asset;

presenting on said display a representation of text messages received from at least one member of said audience;

whereby a visual radio experience is controllably provided by allowing a plurality of visual assets or said textual representation to be selectably streamed to said audience in controllable correlation with said streaming of said primary media content.

3. The method of claim 2, said method further comprising:

providing offers to sell at least one of said visual assets in said streamed assets.

4. The method of claim 2, said method further comprising:

providing surveys selectably capable of being included in said streamed assets.

5. The method of claim 3, said method further comprising:

providing a text editor for editing a caption or price information for a visual asset to be streamed.

6. The method of claim 3, wherein:

at least one of said icons corresponds to a visual asset comprising a ringtone.

7. The method of claim 3, wherein:

at least one of said icons corresponds to a visual asset comprising digital wallpaper.

8. The method of claim 3, wherein:

at least one of said icons corresponds to a visual asset comprising an image.

9. The method of claim 3, wherein:

at least one of said icons corresponds to a visual asset comprising a video clip.

10. The method of claim 3, wherein:

at least one of said icons corresponds to a visual asset comprising downloadable digital data.

11. The method of claim 3, wherein:

at least one of said icons corresponds to a visual asset comprising a game.

12. A method for providing an interactive content experience, comprising:

receiving primary media content and secondary content; streaming said primary media content to at least one mobile device;

streaming said secondary content to said at least one mobile device, said secondary content comprising a series of visual assets controllably selected for streaming in temporal or contextual correlation with said primary media content; and

receiving interactive responses relating to at least one of said visual assets from said at least one mobile device.

13. The method of claim 12, further comprising:

altering said series of visual assets by adding, removing, deleting, or changing the order of visual assets in said series; and

altering said primary media content in response to at least one of said interactive responses.

14. A method for providing a visual radio experience, said method comprising:

receiving, at a programmable mobile device, a streaming radio program;

receiving at said device a series of icons corresponding to visual assets wherein said icons have been controllably selected for streaming;

depicting said icons on a display on said mobile device;

providing interactive capability for a user of said mobile device;

whereby said mobile device provides both a radio program and visual assets concurrently with an interactive capability.

15. The method of claim 14, wherein:

said radio program comprises primary media content.

16. The method of claim 14, wherein:

said series of icons comprises secondary content.

17. The method of claim 14, wherein said step of providing interactive capability further comprises:

providing a selector for initiating a request to buy a visual asset.

18. The method of claim 14, wherein said step of providing interactive capability further comprises:

providing text messaging capability for a user of said device.

19. The method of claim 14, wherein said step of providing interactive capability further comprises:

providing a survey capable of being responded to by a user of said device.

20. The method of claim 14, wherein said step of providing interactive capability further comprises:

providing a contest capable of being entered by a user of said device.

21. A software product, tangibly embodied in an information carrier, for providing a visual radio experience, the software product comprising instructions to cause data processing apparatus to perform operations comprising:

streaming digital content from a media distributor directed to an audience comprising at least one consumer device, wherein said digital content comprises primary media content and secondary content;

relaying said communication to said media distributor, whereby said media distributor is provided feedback for controllably selecting said primary or secondary content.