Patents by Inventor Gary J. Sullivan
Gary J. Sullivan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250365442Abstract: Innovations for signaling state of a decoded picture buffer (“DPB”) and reference picture lists (“RPLs”). In example implementations, rather than rely on internal state of a decoder to manage and update DPB and RPLs, state information about the DPB and RPLs is explicitly signaled. This permits a decoder to determine which pictures are expected to be available for reference from the signaled state information. For example, an encoder determines state information that identifies which pictures are available for use as reference pictures (optionally considering feedback information from a decoder about which pictures are available). The encoder sets syntax elements that represent the state information. In doing so, the encoder sets identifying information for a long-term reference picture (“LTRP”), where the identifying information is a value of picture order count least significant bits for the LTRP. The encoder then outputs the syntax elements as part of a bitstream.Type: ApplicationFiled: August 1, 2025Publication date: November 27, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Yongjun Wu
-
Patent number: 12464163Abstract: Innovations in signaling of reference picture list (“RPL”) modification information. For example, a video encoder evaluates a condition that depends at least in part on a variable indicating a number of total reference pictures. Depending on the results of the evaluation, the encoder signals in a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. A video decoder evaluates the condition and, depending on results of the evaluation, parses from a bitstream a flag that indicates whether an RPL is modified according to syntax elements explicitly signaled in the bitstream. The condition can be evaluated as part of processing for an RPL modification structure that includes the flag, or as part of processing for a slice header. The encoder and decoder can also evaluate other conditions that affect syntax elements for list entries of the RPL modification information.Type: GrantFiled: August 9, 2023Date of Patent: November 4, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Patent number: 12464166Abstract: Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.Type: GrantFiled: July 31, 2024Date of Patent: November 4, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Patent number: 12452459Abstract: Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.Type: GrantFiled: July 31, 2024Date of Patent: October 21, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Publication number: 20250324079Abstract: Innovations in intra block copy (“BC”) prediction as well as innovations in encoder-side search patterns and approaches to partitioning are described herein. For example, some of the innovations relate to use of asymmetric partitions for intra BC prediction. Other innovations relate to search patterns or approaches that an encoder uses during block vector estimation (for intra BC prediction) or motion estimation. Still other innovations relate to uses of BV search ranges that have a horizontal or vertical bias during BV estimation.Type: ApplicationFiled: June 25, 2025Publication date: October 16, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Lihua Zhu, Yongjun Wu, Gary J. Sullivan
-
Publication number: 20250324056Abstract: Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency when switching between color spaces during encoding and decoding. For example, some of the innovations relate to adjustment of quantization or scaling when an encoder switches color spaces between units within a video sequence during encoding. Other innovations relate to adjustment of inverse quantization or scaling when a decoder switches color spaces between units within a video sequence during decoding.Type: ApplicationFiled: June 25, 2025Publication date: October 16, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Bin Li, Jizheng Xu, Gary J. Sullivan
-
Publication number: 20250324080Abstract: Innovations in intra block copy (“BC”) prediction as well as innovations in encoder-side search patterns and approaches to partitioning are described herein. For example, some of the innovations relate to use of asymmetric partitions for intra BC prediction. Other innovations relate to search patterns or approaches that an encoder uses during block vector estimation (for intra BC prediction) or motion estimation. Still other innovations relate to uses of BV search ranges that have a horizontal or vertical bias during BV estimation.Type: ApplicationFiled: June 25, 2025Publication date: October 16, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Lihua Zhu, Yongjun Wu, Gary J. Sullivan
-
Publication number: 20250324078Abstract: Innovations in intra block copy (“BC”) prediction as well as innovations in encoder-side search patterns and approaches to partitioning are described herein. For example, some of the innovations relate to use of asymmetric partitions for intra BC prediction. Other innovations relate to search patterns or approaches that an encoder uses during block vector estimation (for intra BC prediction) or motion estimation. Still other innovations relate to uses of BV search ranges that have a horizontal or vertical bias during BV estimation.Type: ApplicationFiled: June 25, 2025Publication date: October 16, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Lihua Zhu, Yongjun Wu, Gary J. Sullivan
-
Patent number: 12445650Abstract: Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.Type: GrantFiled: July 31, 2024Date of Patent: October 14, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Publication number: 20250317597Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: ApplicationFiled: June 17, 2025Publication date: October 9, 2025Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 12439091Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).Type: GrantFiled: July 10, 2024Date of Patent: October 7, 2025Assignee: Microsoft Technology Licensing, LLCInventor: Gary J. Sullivan
-
Patent number: 12413782Abstract: Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.Type: GrantFiled: February 16, 2024Date of Patent: September 9, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Patent number: 12413771Abstract: Innovations in the area of prediction of block vector (“By”) values improve encoding or decoding of blocks using intra block copy (“BC”) prediction. For example, some of the innovations relate to use of a default BV predictor with a non-zero value. Other innovations relate to use of a selected one of multiple BV predictor candidates for a current block. Still other innovations relate to use of a skip mode in which a current intra-BC-predicted block uses a predicted BV value.Type: GrantFiled: January 4, 2024Date of Patent: September 9, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Lihua Zhu, Gary J. Sullivan, Jizheng Xu, Sridhar Sankuratri, B. Anil Kumar, Feng Wu
-
Patent number: 12407853Abstract: Innovations for signaling state of a decoded picture buffer (“DPB”) and reference picture lists (“RPLs”). In example implementations, rather than rely on internal state of a decoder to manage and update DPB and RPLs, state information about the DPB and RPLs is explicitly signaled. This permits a decoder to determine which pictures are expected to be available for reference from the signaled state information. For example, an encoder determines state information that identifies which pictures are available for use as reference pictures (optionally considering feedback information from a decoder about which pictures are available). The encoder sets syntax elements that represent the state information. In doing so, the encoder sets identifying information for a long-term reference picture (“LTRP”), where the identifying information is a value of picture order count least significant bits for the LTRB. The encoder then outputs the syntax elements as part of a bitstream.Type: GrantFiled: November 3, 2023Date of Patent: September 2, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Yongjun Wu
-
Patent number: 12375668Abstract: Innovations in adaptive encoding and decoding for units of a video sequence can improve coding efficiency when switching between color spaces during encoding and decoding. For example, some of the innovations relate to adjustment of quantization or scaling when an encoder switches color spaces between units within a video sequence during encoding. Other innovations relate to adjustment of inverse quantization or scaling when a decoder switches color spaces between units within a video sequence during decoding.Type: GrantFiled: February 6, 2024Date of Patent: July 29, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Bin Li, Jizheng Xu, Gary J. Sullivan
-
Patent number: 12375711Abstract: Innovations in encoder-side search ranges having horizontal bias or vertical bias are described herein. For example, a video encoder determines a block vector (“BV”) for a current block of a picture, performs intra prediction for the current block using the BV, and encodes the BV. The BV indicates a displacement to a region within the picture. When determining the BV, the encoder checks a constraint that the region is within a BV search range having a horizontal bias or vertical bias. The encoder can select the BV search range from among multiple available BV search ranges, e.g., depending at least in part on BV values of one or more previous blocks, which can be tracked in a histogram data structure.Type: GrantFiled: March 28, 2024Date of Patent: July 29, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Lihua Zhu, Yongjun Wu, Gary J. Sullivan
-
Patent number: 12368884Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: GrantFiled: November 28, 2022Date of Patent: July 22, 2025Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Publication number: 20250227289Abstract: Innovations in intra block copy (“BC”) prediction mode facilitate intra BC prediction that is more effective in terms of rate-distortion performance and/or computational efficiency of encoding and decoding. For example, some of the innovations provide ways to select block vector (“BV”) values more effectively. Other innovations provide ways to encode/decode BV values more efficiently. Still other innovations address how to perform in-loop deblock filtering when a block has intra BC prediction mode, or address how to perform intra BC prediction when constrained intra prediction is enabled.Type: ApplicationFiled: March 27, 2025Publication date: July 10, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Bin Li, Jizheng Xu, Gary J. Sullivan
-
Publication number: 20250227282Abstract: Innovations in intra block copy (“BC”) prediction as well as innovations in encoder-side search patterns and approaches to partitioning are described herein. For example, some of the innovations relate to use of asymmetric partitions for intra BC prediction. Other innovations relate to search patterns or approaches that an encoder uses during block vector estimation (for intra BC prediction) or motion estimation. Still other innovations relate to uses of BV search ranges that have a horizontal or vertical bias during BV estimation.Type: ApplicationFiled: March 25, 2025Publication date: July 10, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Lihua Zhu, Yongjun Wu, Gary J. Sullivan
-
Publication number: 20250227285Abstract: Innovations in intra block copy (“BC”) prediction as well as innovations in encoder-side search patterns and approaches to partitioning are described herein. For example, some of the innovations relate to use of asymmetric partitions for intra BC prediction. Other innovations relate to search patterns or approaches that an encoder uses during block vector estimation (for intra BC prediction) or motion estimation. Still other innovations relate to uses of BV search ranges that have a horizontal or vertical bias during BV estimation.Type: ApplicationFiled: March 25, 2025Publication date: July 10, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Lihua Zhu, Yongjun Wu, Gary J. Sullivan