DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0087] A multimedia authoring and playback system for use in a computer-based environment is disclosed. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide an understanding of the present invention; also, in certain instances, structures and devices are shown in block diagram form to facilitate explanation. However, it will be evident to those of ordinary skill in the art that the present invention may be practiced without the specific details and forms. The description of the preferred embodiments is not intended to limit the scope of the claims appended hereto.

[0088] The following description has four sections: (1) Functional Overview, (2) Example Scenarios, (3) Hardware Overview, and (4) System Architecture.

[0089] Functional Overview

[0090] The present invention is best understood in terms of the user experience it provides. Therefore, the invention is now described with an emphasis on the user experience, along with a moderate amount of explanation of the underlying system operations and data management procedures occurring at each point.

[0091] In this functional overview, various examples are shown in which an author creates and manipulates multimedia content by means of a graphical user interface (GUI). This GUI includes a “playback display” for viewing and editing content which is playing, and optionally, a “control display” for performing various management and control functions. These displays can take many forms on many different platforms, and the specific display representations are not to be understood as limiting or restricting the appearance or implementation of the playback display or control display.

[0092] To help clarify the workings of the invention, three common representations are used in many of the diagrams that accompany this functional overview: (1) to the left an abstract representation of the presentation data (which is merely for illustration and does not appear to the user), (2) to the right a simplified picture of the playback display, and (3) in the center a simplified picture of the control display (which is included in the diagrams frequently starting at FIG. 29A, and before that is shown in a few instances under the playback display). These three representations may be used separately or in tandem to illustrate different aspects of the workings of the invention.

[0093] To help organize the discussion, the various features of the invention have been grouped into a number of categories which were enumerated in the above summary. Briefly, again, these categories are: (1) creating and importing objects, (2) editing display settings, (3) time-based playback behavior, (4) starting and stopping containers, (5) programming behavior using a sentence paradigm, (6) dynamic parameter modification, (7) control displays, (8) publishing and editing over a network, (9) hierarchical structuring of data, (10) exploration of data, (11) pointer objects, (12) integration of HFS data, (13) user navigation, and (14) sub-displays. The organization of the invention's features into these categories is merely intended as an aid to understanding, and is not intended to imply any inherent associations or disassociations among features simply because they are in the same or in different categories.

[0094] Finally, it should be noted that great care has been taken to ensure that the various features of the invention have been designed to work well together, and in many cases the use of two or more features in conjunction with one another produces advantages beyond those of the individual features. Throughout the following discussion, various examples and explanations are provided to indicate how different features of the invention may be used in conjunction with one another to achieve further advantage.

[0095] The discussion begins with a description of the basic elements of the system, which establishes base levels of functionality for the invention, after which each category of features is discussed in turn.

[0096] BASIC ELEMENTS OF THE SYSTEM—FIGS. 1A-B illustrate the basic elements of the system, shown operating in exemplary object presentation and editing scenarios. These scenarios present certain base levels of functionality found in this and many other multimedia authoring and playback systems. The scenario of FIG. 1A presents the base level of functionality for multimedia playback, which is included in all configurations of the invention. The scenario of FIG. 1B presents the base level of functionality for multimedia authoring, which is included in configurations of the invention that support user editing of presentation data. These respective base levels for playback and authoring provide a foundation upon which the various features of the invention which follow may be added.

[0097] FIG. 1A depicts a basic object presentation scenario, according to one embodiment of the present invention. Shown on the left side of the figure is some exemplary presentation data which consists of a container object containing two media objects. The two media objects are of two different types, such that each media object contains a different type of media data; support for multiple types of media objects is typical in multimedia systems such as the present invention, but not required, since various features of the invention may be practiced effectively using just one media type. Moreover, depending on system configuration, various other types of objects may be supported in addition to, or instead of, those shown in FIG. 1A, as discussed throughout this specification. Shown on the right side of FIG. 1A is an exemplary playback display, which plays back the presentation data by presenting the media data of the media objects in the playback display. Each of these basic elements of the system is now described.

[0098] The left side of FIG. 1A shows a representation of a container object 100 containing two media objects 102 and 106. In the present invention, a container object is any data construct which can be used to collect two or more media objects (examples from the field abound, and include such constructs as HTML files, folders in a hierarchical file system, proprietary data formats, etc.). Note that physical containment of media objects by the container object is not required; all that is required is the ability to create a logical collection of two or more media objects.

[0099] In the example of FIG. 1A, the two media objects contained by the container object 100 are a text object 102 and a picture object 106. Shown within the text object 102 is media data 103, in this case text data (which can include data representing alphanumeric text such as ASCII characters, data representing other national character sets such as Kanji characters, data representing various text properties such as bold and italic, etc.). In the text object 102, the media data 103 is depicted as distinct from the rest of the object data 104 (the latter of which can include such data as object properties, display settings for the media data, various other presentation options, etc.). Similarly, within the picture object 106 is shown media data 107, in this case image data (which can include various types of data for representing visual images, such as bitmaps, vector graphics, etc.), also depicted as distinct from the rest of the object data 108. This depiction of media data as distinct from the rest of the object data is merely a visual convention used throughout the diagrams to help clarify certain concepts and features, and is not intended to describe or limit the structures used for the actual storage of object data.

[0100] The right side of FIG. 1A shows a representation of a playback display 116 which is displaying the text “Hello World” 112 corresponding to the text object 102, as well as the picture 114 corresponding to the picture object 106. The playback display 116 also includes a display title 110 consisting of the words “PLAY: DEMO,” which indicates that the playback display is playing presentation data and that the source for what is playing is the container object 100 (which is named “DEMO”). This display title 110 and similar display titles in other figures are included within the diagrams to help clarify how objects depicted on the left relate to displays depicted on the right; however such display titles are not required for the invention, and in actual implementations may vary greatly or be omitted altogether.

[0101] FIG. 1B depicts a basic editing scenario, according to one embodiment of the present invention. The figure shows a situation in which the user is preparing to edit a new presentation. The left side of FIG. 1B shows a representation of an empty container object 120 named “NEW.” To the right is a playback display 134, which includes a display title 128 with the words “EDIT: NEW” indicating that the playback display is presenting the container object 120 to the user for editing.

[0102] In the presently preferred embodiment of the invention, editing takes place within an edit mode, such as might be triggered by a user-initiated click of the pointer 132 on the edit mode command icon 130 (this pointer 132, as well as similar pointers shown in other figures, is controlled by the user via a pointing device, such as a computer mouse, joystick, pen and tablet, PDA stylus, touch screen, etc.). It should be noted, however, that the use of an edit mode which is distinct from presentation playback, as shown in FIGS. 1A-B and in other figures, is only one of various possible approaches for providing authoring and playback functionality to the user, and other approaches may be effective depending on system configuration (such as integrating authoring and playback in a common mode, using separate applications for authoring and playback, etc.). For example, the invention can be configured such that an authoring application (with minimal playback functionality) is used to author content, and then a separate playback application with more complete playback functionality (such as a Web browser or proprietary “player” application) is used to test and evaluate the playback of authored content.

[0103] FIG. 1B further includes command icons 122, 124 and 126 as examples of authoring functions that might be selected by the user. It should be noted that the look and placement of command icons throughout the diagrams is exemplary only, and can vary greatly in real embodiments of the system. Moreover, it should further be noted that the use of command icons for selecting authoring functions is merely one approach for doing so, and other approaches may also be effective depending on system implementation (such as single-level menus, multiple-level menus, buttons, lists, sliders, palettes, checkboxes, other types of user interface elements, keypad keys, etc).

[0104] CREATING AND IMPORTING OBJECTS—FIGS. 2A through 3D depict various functions for adding objects to a presentation: (1) FIG. 2A shows creating a new text object, (2) FIG. 2B shows creating a new picture object, (3) FIG. 2C shows importing a picture via dialog box, (4) FIG. 2D shows duplicating a picture using a control display, (5) FIG. 3A shows creating a new picture from a connected camera, (6) FIG. 3B shows recording a new video from a connected camera, (7) FIG. 3C shows creating a new sub-display and associated container object, and (8) FIG. 3D shows importing a sub-display by dragging a container object from a control display. Each of these functions is an independent feature of the invention that may or may not be included in any given system configuration. Moreover, the above functions involving importing and duplicating (FIGS. 2C, 2D and 3D) are general purpose functions which, depending on system configuration, can be used with any of the object types supported by the system.

[0105] The functionality illustrated in FIGS. 2A through 3D generally provides the advantage of allowing users to add objects to presentations with greater speed and efficiency, enabling the creation of more interesting presentations with less effort. Also, when the functions of FIGS. 2D and 3D are used with control displays that allow user exploration of a hierarchical file system (such as that shown in FIGS. 35A-B), further advantages are produced in terms of enabling faster, more comprehensive access to external data. In addition, when functions shown in FIGS. 2A through 3D are used within the context of “compound sentence” programming as discussed in connection with the sentence paradigm, their integration into the process of creating programmed object behavior produces further advantages in terms of faster, more streamlined authoring. Moreover, when functions of FIGS. 2A through 3D are used in conjunction with other features of the invention, such as editing display settings, time-based playback behavior, networking, collaborative editing, pointer objects, etc., further advantages are derived in terms of enabling authors to create multimedia content with greater variety among object characteristics with less effort, and to more easily add objects to distributed content.

[0106] FIG. 2A shows the creation of a new text object, according to one embodiment of the present invention. The figure shows a playback display 216 presenting a container object 200 to the user for editing. First, the user clicks on the new text command icon 204. Next, the user clicks on a desired spot 212 in the playback display 216, causing a new text box 206 to be displayed there. The new text box 206 contains a cursor 210 indicating that the user can, if desired, enter new text; as new text 208 “Hello” is entered, the cursor 210 follows the last character entered. When the user is done entering text, the pointer 214 is clicked at any spot in the playback display that is outside text box 206, completing the operation. As a result of this process, as seen in the representation on the left side of FIG. 2A, a new text object 202 is created within the container object 200, the new text object containing text data for the new text “Hello” 208 in its media data 203.

[0107] FIG. 2B shows the creation of a new picture object, according to one embodiment of the present invention. The figure shows a playback display 236 presenting a container object 220 to the user for editing. First, the user clicks on the new picture command icon 224. Next, the user clicks on a desired spot 226 in the playback display 236, causing a new picture 228 (in this case a solid rectangle) to appear there. The user may then, while still pressing the mouse button or other pointing device, adjust the size of the picture to a desired size 234 by dragging across the playback display (230, 232). As a result of this process, as seen in the representation on the left side of FIG. 2B, a new picture object 222 is created within container object 220, the new picture object containing image data for the new picture 228 in its media data 223. Note that other versions of this function for creating a new picture object may be provided for other kinds of images, such as circles, lines of various types, “spray can” effects, other geometric shapes and patterns, etc., any or all of which may employ a “click and drag” operation such as that seen in the picture creation function of FIG. 2B.

[0108] FIG. 2C shows a new picture object being imported into the system from an external picture file using a dialog box, according to one embodiment of the present invention. The figure shows a playback display 258 presenting a container object 240 to the user for editing. First, the user clicks on the import command icon 244, which causes a file selection dialog box 246 to appear. In the file selection dialog box 246, several external picture files 248 are shown, which may be standard graphics files such as JPEG, TIFF, BMP or similar files stored in an accessible storage location. The picture file 250 named “Mona Lisa” is selected and the user clicks the “OK” button 252. The user then clicks at a desired location 256 in the playback display 258, and the picture 254 from the selected picture file appears there. As a result of this process, as seen in the representation on the left side of FIG. 2C, a new picture object 242 is created within the container object 240, the new picture object containing image data for the imported picture 254 in its media data 243.

[0109] FIG. 2D shows a new picture object being imported into the system from an external picture file using a duplicate command with a control display, according to one embodiment of the present invention. The figure shows a playback display 270 presenting a container object 260 to the user for editing. Below the playback display 270 is a control display 274. This control display, like the file selection dialog 246 of FIG. 2C, presents several external picture files to the user; however unlike the file selection dialog, the control display can have a persistent presence within the user interface. To import a picture, the user first clicks on a desired picture icon 272 in the control display 274. Next, the user clicks on the duplicate command icon 264. Finally, the user clicks on a desired location 268 in the playback display 270, and the picture 266 appears there. As a result of this process, as seen in the representation on the left side of FIG. 2D, a new picture object 262 is created within the container object 260, the new picture object containing image data for the imported picture 266 in its media data 263. In addition to duplicating an object from a control display to a playback display, as seen in the present example, the duplicate function may also be used to duplicate an object from one control display to another, or to duplicate an object within a single control display or playback display.

[0110] FIG. 3A shows a new picture object being created through the use of a connected camera, such as a “web cam,” according to one embodiment of the present invention. The figure shows a playback display 316 presenting a container object 300 to the user for editing. First, the user clicks on the camera command icon 304, which causes a dialog window 310 to appear containing a real-time view 306 of the output of a camera (the camera might be directly attached to the user's computer or accessed over a network). When the real-time view 306 presents a desired image, the user clicks the OK button 308 to accept the image. The user then clicks at a desired location 312 in the playback display 316, and the image appears there as a picture 314. As a result of this process, as seen in the representation on the left side of FIG. 3A, a new picture object 302 is created within the container object 300, the new picture object containing image data for the picture 314 in its media data 303.

[0111] FIG. 3B shows a new video object being created through the use of a connected camera, such as a “web cam,” according to one embodiment of the present invention. The figure shows a playback display 338 presenting a container object 320 to the user for editing. First, the user clicks on the video command icon 324, which causes a dialog window 332 to appear containing a real-time view 326 of the output of a camera (the camera might be directly attached to the user's computer or accessed over a network). The user then clicks the REC button 328 to commence video recording. Optionally, the user may stop recording by clicking again on the REC button 328, and may view what has been recorded by clicking on the PLAY button 329. When the desired recording has been achieved, the user clicks the OK button 330 to accept the recording. The user then clicks at a desired location 334 in the playback display 338, and the recorded video 336 appears there. As a result of this process, as seen in the representation on the left side of FIG. 3B, a new video object 322 is created within the container object 320, the new video object containing video data for the video 336 in its media data 323.

[0112] In the case of the functions of FIGS. 3A and 3B just described (new picture from camera and new video from camera), the user interfaces provided in the dialog windows 310 and 332 for capturing (respectively) image data and video data are typical; many variations for such user interfaces are common, and may be effective in the present invention. A significant portion of the advantage of the above functions lies in the fact that after accepting the image or recording (by clicking on the OK button in the above examples), the user need only make one final click (specifying a location in the playback display) to incorporate the new data into the presentation.

[0113] Moreover, in either or both of the dialog windows (310, 332) in FIGS. 3A and 3B, a “soft oval” effect may be provided as an optional enhancement. With this enhancement, the user is given an option to apply a soft oval effect to the real-time view (306, 326) of the output of the camera. This soft oval effect is similar to that shown in FIGS. 6B-2, except that it affects the live output of the camera in real time. In the examples of FIGS. 3A and 3B, the user can enable this soft oval effect via the checkboxes (309, 331) in the respective dialog windows; however, as mentioned above for dialog windows in general, other user interface variations for enabling this soft oval effect may also be effective. With the soft oval effect enabled, once the picture or recorded video is accepted by the user, the media data of the newly created object (302, 322) exhibits the soft oval effect when displayed in the playback display (which is especially effective when used with “head shot” pictures or “talking head” videos). In the preferred implementation, this is accomplished by setting relevant display settings (shape and softness as discussed in connection with FIGS. 6A-B) at the time the new picture or video object is created, which allows the user to further adjust or disable the soft oval effect afterwards; however it is also possible to implement this feature in ways which do not allow further adjustment of the effect after accepting the picture or video.

[0114] FIGS. 3C and 3D show new and import functions (respectively) which involve sub-displays. The sub-display functionality of the present invention is discussed in detail in connection with FIGS. 40 through 45C, but briefly, it involves an association between nested sub-displays in the playback display and container objects, whereby media data of objects contained in a container object is displayed within the sub-display associated with the container object. The examples of FIGS. 3C and 3D also involve the use of another feature of the invention, hierarchically nested container objects, detailed in connection with FIGS. 32A-B.

[0115] FIG. 3C shows the creation of a new sub-display and associated container object, according to one embodiment of the present invention. The figure shows a playback display 350 presenting a container object 340 to the user for editing. First, the user clicks on the new sub-display command icon 344. Next, the user clicks on a desired spot 346 in the playback display 350, causing a new sub-display 348 to appear there. As a result of this process, as seen in the representation on the left side of FIG. 3C, a new container object 342 is created within the container object 340. This new container object 342 is associated (as shown by its double outline) with the new sub-display 348 shown in the playback display. Other objects such as text, pictures, etc. may now be added to the new container object using methods such as those shown in FIGS. 2A through 3B, and their media data will be displayed within the new sub-display 348.

[0116] FIG. 3D shows importing a sub-display by dragging a container object from a control display, according to one embodiment of the present invention. The figure shows a playback display 376 presenting a container object 360 to the user for editing. Below the playback display 376 is a control display 380 which presents several container objects to the user; these container objects may be external data files located in an accessible storage location, or references to such files (such as via URL), or some other form of collected, contained presentation data. To import a sub-display, the user first clicks on a desired container object icon 378 in the control display 380 (note that the desired container object need not itself be associated with a sub-display). Next, while still pressing the mouse button or other pointing device, the user “drags” the pointer to a desired location 372 in the playback display 376 and releases, causing a sub-display 374 to appear there (this can also be accomplished using either the import function of FIG. 2C or the duplicate function of FIG. 2D). As a result of this process, as seen in the representation on the left side of FIG. 3D, a new container object 362 containing data from the selected container object 378 is created within the container object 360. This new container object 362 is associated (as shown by its double outline) with the sub-display 374, and the media data for its contained objects (the text object 364 and the picture object 366) is seen within the sub-display 374 as the text 368 and the picture 370, respectively.

[0117] EDITING DISPLAY SETTINGS—FIGS. 4A through 6B illustrate editing functions for changing various “display settings” that determine how an object's media data is presented in the playback display. The display settings shown being changed in these figures are: (1) position in FIG. 4A, (2) size and position in FIG. 4B, (3) color in FIG. 4C, (4) transparency in FIG. 5A, (5) rotation in FIG. 5B, (6) stretch in FIG. 5C, (7) cropping in FIG. 5D, (8) shape and softness in FIG. 6A, and (9) shape and softness in FIG. 6B. Each of the editing functions shown in these figures, as well as each of the display settings involved, is an independent feature of the invention that may or may not be included in any given system configuration.

[0118] The functionality illustrated in FIGS. 4A through 6B generally provides the advantage of faster and more convenient modification of object display settings, which allows users to create more personalized and expressive presentations more quickly. Moreover, the editing features of FIGS. 4A through 6B, when used in conjunction with each other and with other features of the invention, such as time-based playback behavior, functions of the sentence paradigm, networking, collaborative editing, sub-displays, etc., provide the further advantage of increased speed and efficiency in the creation of highly sophisticated and/or distributed multimedia content.

[0119] It should be noted that in FIGS. 4A through 6B, editing functions are shown affecting the appearance of exemplary text and picture objects; depending on system configuration, each of these editing functions (or similar editing functions) may be used to change the appearance of any of the following: text, pictures, videos and sub-displays (sub-displays are detailed in connection with FIGS. 40 through 45C). It should also be noted that for the functions of FIGS. 4A through 6B which involve the use of keypad keys, other keypad keys and/or user interface elements (such as sliders, buttons, etc.) may be provided to perform the same functions. It should also be noted that in the examples of FIGS. 4A through 6B, and throughout the present specification, the presence and involvement of selection boxes is merely for clarity in the diagrams, and is not essential to the functionality being shown.

[0120] FIG. 4A shows editing of the display position of an object's media data in the playback display, according to one embodiment of the present invention. The figure shows a text object 402 whose media data is seen in the playback display 412 as text 406. The user selects the text by clicking on it with the pointer 408, causing a selection box 404 to appear around the text indicating that it can be dragged. The user can then drag the selected text to a desired location 410 in the playback display 412.

[0121] FIG. 4B shows simultaneous editing of the position and size of an object's media data in the playback display, according to one embodiment of the present invention. The figure shows a text object 416 whose media data is seen in the playback display 430 as text 420. The user selects the text by clicking on it with the pointer 422, causing a selection box 418 to appear around the text indicating that it can be dragged. The user can then drag the selected text to a desired location 428 in the playback display 430. During the time that selection box 418 is displayed around the text, the user may also re-size the text (whether dragging it or not) by pressing the up-arrow key 432 on a keypad, making the text larger, as seen in the increased size of the text 426 and its selection box 424. Similarly, the down-arrow key 434 may be used to make the text smaller.

[0122] FIG. 4C shows editing of the color of an object's media data in the playback display, according to one embodiment of the present invention. In FIGS. 4C-1, the media data of a text object is seen in the playback display 456 as text 452. The user first clicks on the color change command icon 450, then clicks 454 on the text to select it (in an alternate implementation, the text may be selected first and then the command icon; also, in yet another alternate implementation, both the command and the text may be selected at once by clicking on the text using an alternate form of click, such as by pressing the right-side mouse button, or by clicking with a modifier key such as “alt” or “ctrl” held down, etc.).

[0123] FIGS. 4C-2 shows that when the above selection has occurred, a color adjust mode is entered, as indicated by special cursor symbol 460. The user may then move the mouse or other pointing device 480 in any of four directions to adjust the color. Left movement 484 or right movement 478 is used to adjust the hue toward the red end 474 of the color spectrum (left) or the violet end 486 of the spectrum (right). Up movement 476 or down movement 482 is used to make the brightness of the color more bright 468 (up) or more dark 494 (down). In short, the four directions form a “color grid” 492 which controls the hue and brightness of the object being affected. All of the color changes happen in real time to the displayed media data 452 in the playback display 456.

[0124] Beyond the basic functionality of color adjust mode just discussed, a variety of variations or enhancements such as the following are possible. For one, the color grid may be extended in the horizontal dimension 490 and 470, so that the hue values “wrap around” (from red 474 to violet 472, and from violet 486 to red 488) when the user moves the mouse or pointing device beyond the point corresponding to the extreme value of hue in either direction. Also, when in color adjust mode, the up and down arrow keys 464 may be used to increase and decrease the color saturation. In addition, alternate mappings between hue and brightness and the vertical and horizontal axes of the color grid may be effective, such as swapping or inverting the axes. Also, an alternate implementation may be provided in which color adjust mode involves clicking and holding down the mouse button or pointing device. Note that the special cursor symbol 460 need not be used, and if used, may either move or not during color adjust mode. Finally, color adjust mode may be exited by again clicking the mouse or pointing device (or by releasing the mouse button or pointing device in the alternate implementation involving clicking and holding).

[0125] FIG. 5A shows editing of the transparency of an object's media data in the playback display, according to one embodiment of the present invention. In FIGS. 5A-1, the media data of two picture objects is seen in the playback display 506 as an upper picture 500 and a lower picture 502. The user first selects the upper picture 500 by clicking on it with the pointer 504, then presses the left arrow key 510 on the keypad to increase the transparency of the selected picture. The result is shown in FIGS. 5A-2 in the playback display 506, where the upper picture 500 is now partially transparent, as can be seen from the overlap 508 between the two pictures 500 and 502. Similarly the user may use the right arrow key 512 to decrease the transparency, making the picture 500 more opaque.

[0126] FIG. 5B shows editing of the rotation of an object's media data in the playback display, according to one embodiment of the present invention. In FIGS. 5B-1, the media data of a picture object is seen in the playback display 524 as a picture 520. First, the user selects the picture 520 by clicking on it with the pointer 522. Then, while holding the mouse button or other pointing device down, the user presses the right arrow key 528 on the keypad to rotate the picture 520 clockwise. The result is shown in FIGS. 5B-2 in the playback display 524, where the picture 520 is now shown rotated. Similarly, the left arrow key 526 can be used to rotate the picture counter-clockwise. The position of the picture 520 may also be dragged using the pointer 522 at the same time it is being rotated by the kepad keys. In systems which support use of the left and right arrow keys for both rotation and transparency (the latter being seen in FIG. 5A), the pressing and holding of the mouse button or pointing device is used as the condition for assigning the keys to rotation.

[0127] FIG. 5C shows stretching of an object's media data in the playback display, according to one embodiment of the present invention. In FIGS. 5C-1, the media data of a picture object is seen in the playback display 546 as a picture 540, surrounded by a selection box 542 indicating that it has previously been selected by the user. This selection box has a drag handle 544 on each of its sides (which can alternately be placed at the corners of the selection box, in which case they may, depending on configuration, be locked to a fixed aspect ratio to provide size control). The user may click on a drag handle 544 and drag it away from the center of the picture, stretching the picture in the direction of the movement. The result is shown in FIGS. 5C-2 in the playback display 546, where the picture 540 and selection box 542 appear elongated as a result of the movement of the drag handle 544. The user may also compress the picture by dragging a drag handle toward the center of the picture.

[0128] FIG. 5D shows cropping of an object's media data in the playback display, according to one embodiment of the present invention. In FIGS. 5D-1, the media data of a picture object is seen in the playback display 566 as a picture 560, surrounded by a selection box 562 indicating that it has previously been selected by the user. This selection box has a corner drag handle 564 in each of its corners (which can alternately be placed at the sides of the selection box). The user may click on a corner drag handle 564 and drag it to change the cropping of the picture, i.e., the portion of it being “revealed” in the playback display. The result is shown in FIGS. 5D-2 in the playback display 566, as the outer edges 568 of the picture 560 now appear cropped as a result of the movement of the drag handle 564. Greater or lesser portions of the picture may be revealed by dragging in this manner.

[0129] FIG. 6A shows editing of the shape and softness of an object's media data in the playback display using sliders, according to one embodiment of the present invention. In FIGS. 6A-1, the media data of a picture object is seen in the playback display 604 as a picture 600. When the user clicks 602 on the picture 600, various sliders may appear depending on system configuration, as shown in FIGS. 6A-2 through 6A-4.

[0130] FIGS. 6A-2 shows a system configured so that clicking on the picture 600 in the playback display 604 causes a shape slider 614 to appear. As the shape slider control is moved to the right with the pointer 618, the edges of the picture become increasingly rounded until they collapse into a diamond. The shape slider control left position 612 corresponds to the original rectangular shape of the picture 600. The middle position 616 corresponds to the oval shape indicated by the middle boundary 608, and the right position 620 corresponds to the diamond shape 610. Depending upon implementation, the extreme setting for the shape change, corresponding to the right position 620, may also be a shape other than a diamond, such as limiting it to just an oval, or going beyond a diamond to a “four point compass rose” shape, etc. In addition, shapes other than those shown in the example of FIG. 6B may be provided, such as other geometric shapes, arbitrary shapes, etc.

[0131] FIGS. 6A-3 shows a system configured so that clicking on the picture 600 in the playback display 604 causes a softness slider 624 to appear. Moving the softness slider control 626 up makes the edges of the picture appear increasingly soft or “fuzzy;” i.e. the picture becomes increasingly transparent 622 away from the center and toward the edges (of course this depiction of fuzziness in the diagram is suggestive only, and the exact effect may vary according to implementation). The greater the slider setting, the greater the softness; i.e. the more extreme the “fuzziness” becomes. The minimum position 628 of slider 624 corresponds to the original “hard outline” of the picture; i.e. no softness.

[0132] FIGS. 6A-4 shows a system configured so that clicking on the picture 600 in the playback display 604 causes both a shape slider 644 and a softness slider 636 to appear. In this configuration, the shape and softness effects may be combined, independently controllable via the shape and softness sliders according to the rules previously described. In the example shown, the shape slider control 646 is moved to the mid position, and the softness slider control 638 is also moved to the mid position, resulting in a “soft oval” effect 634.

[0133] FIG. 6B shows editing of the shape and softness of an object's media data in the playback display using dragging, according to one embodiment of the present invention. In FIGS. 6B-1 the media data of a picture object is seen in the playback display 656 as a picture 652. The user first clicks the shape/softness command icon 650, then selects the picture by clicking on it with the pointer 654 (in an alternate implementation, the picture may be selected first and then the command icon; also, in yet another alternate implementation, both the