complexityrepaired

RequirementsforFutureVideoCoding(H.
FVC)(Ref:ReportSG16-R1,AnnexI;Approved2017-01-27)ThisdocumentcontainsrequirementsforthefirstphaseofapotentialFutureVideoCoding("H.
FVC",a.
k.
a.
FVC)videocodingstandardizationproject.
The"H.
FVC"projectisexpectedtodevelopanewRecommendation|InternationalStandardoranextensionofHEVC(ITU-TRec.
H.
265|ISO/IEC23008-2),dependingonwhichformofstandardizationisdeterminedtobeappropriateforthetechnologydesign.
1ApplicationsRequirement:–FVCshouldbecapableofservingtheneedsofnumerousapplications,including:oBroadcast.
oDigitalcinemaandlarge-screendigitalimagery.
oLow-delayinteractivecommunication.
oMobilecommunicationandentertainment.
oStreaming,download-and-play,andstorage-media-basedapplications.
oSurveillanceandsmarthome.
oVideoondemand.
oVirtual,augmentedandmixedrealityforcommunication,interactionandentertainment.
oUser-generatedimagesandvideo.
oScreencontent.
oGaming.
oMultispectralcontent.
oAutomatedanalysisofvideocontent.
oInternetofThings,industrialapplications,automotive,robotics,anddigitalmedicine.
2CompressionCapabilityRequirement:–FVCshouldbecapableofprovidingabitratereductionofapproximately50%atthesamesubjectivequalitycomparedtoHEVCasusedintheseapplications.
3ComplexityComplexityreferstocomputationalresourceconsumption(intermsofpowerconsumption,computingcycles,memorycapacity,memorybandwidth,etc.
),includingconsiderationoftypicalcomputingarchitecturesandparallelization.
Requirements:–FVCcomplexityshallallowforfeasibleimplementationwithintheconstraintsoftheavailabletechnologyattheexpectedtimeofusage.
–FVCdecodercomplexityshallbeconsidered.
Real-timedecodingshallbefeasiblewithintheconstraintsoftheavailabletechnologyattheexpectedtimeofusage.
Applicationswithpartialspatialregiondecodingofthebitstream(e.
g.
VRandAR)andtheassociatedimpactondecodercomplexityshouldbeconsidered.
–Theencodercomplexitythatisnecessaryforachievingadesiredcompressionefficiencyshallbetakenintoconsideration.
FVCencodersshouldbecapableoftradingoffcomplexityandcodingefficiency.
Real-timeencodingwithadequatecodingefficiencyshallbefeasiblewithintheconstraintsoftheavailabletechnologyattheexpectedtimeofusage.
Non-real-timecodingwithfurtherimprovementofcodingefficiencyshouldalsobeconsidered.
4PacketlossrobustnessTransmissionofFVCbitstreamsovererror-pronenetworksmaybeaffectedbypacketlossesthat,forsomevideoapplications,cannotberepairedbythenetwork.
Requirement:–FVCshallbecapableofrobustoperationinthepresenceofpacketlosses.
Remark:Aspectsofthesystem-levelsupport,encoderoptimizationanddecoderconcealmentbehaviornecessarytoachievethis,maynotbewithinthenormativescopeofFVC.
RobustnesscapabilitysimilartothatofHEVCMainProfileisconsideredacceptable.
5End-to-enddelayEncoderprocessingtimeisthetimedistanceusedbyanencoderstartingfromtheinputofthefirstvideosampleandendingwiththeoutputofthelastbitrepresentingthatpicture.
Decoderprocessingtimeisthetimedistanceusedbyadecoderstartingfromtheinputofthefirstbitandendingwiththeoutputofthelastvideosamplerepresentingthatpicture.
Lowend-to-enddelayisaminimizedtimedistancethatisequaltothesumoftheminimumencoderprocessingtimeandminimumdecoderprocessingtime,whilerepresentingthevideosignalatadesiredcodingefficiency.
Ultra-lowend-to-enddelayisaminimizedtimedistancethatisshorterthanthesumoftheminimumencoderprocessingtimeandminimumdecoderprocessingtime,whilerepresentingthevideosignalatadesiredcodingefficiency.
Requirements:–FVCshallbecapableoflowend-to-enddelayoperation,efficientlyenablinginteractiveandconversationalapplications.
–FVCshouldbecapableofultra-lowend-to-enddelayoperation,efficientlyenablingthecorrespondingapplications.
Remark:FVCshouldbecapableoftradingoffcomputationalcomplexity,compressionefficiency,andlossrobustnesswithdelaycharacteristics.
6Randomaccessand"Trickmode"supportRequirements:–FVCshallhavesupportforrandomaccesspointsinthevideobitstreamforfunctionalitysuchaschannelswitchingandprogramchapteraccess.
–FVCshallhavesupportforpause,fastforward,normalspeedreverse,andfastreverseaccesstoastoredvideobitstream.
7InterfacetosystemslayerRequirements:–FVCshouldbedesignedtopermitefficientadaptationandintegrationwithabroadvarietyofsystemanddeliverylayersrelevanttotheintendedapplications.
Buffermodels,includinghypotheticalreferencedecoders(HRDs),shouldbespecifiedasnecessaryfortargetapplications.
–FVCshouldsupportbitrateadaptivityoverarangeofatleastoneorderofmagnitudewithinacodedvideosequenceorequivalent.
8BitdepthandcoloursamplingRequirements:–FVCshallbecapableofrepresentingvideosignalswithbitdepths8and10.
FVCshouldbecapableofrepresentingvideosignalswithbitdepthsrangingfrom8to16.
–FVCshallbecapableofrepresentingvideosignalswith4:2:0coloursampling.
FVCshouldbecapableofrepresentingvideosignalswithcoloursamplingsrangingfrommonochrometo4:4:4.
–FVCmaybecapableofrepresentingmultispectralimagery,multiviewimagery,andsupplementalpicturerepresentations.
9Resolutions,scanningmethods,andframeratesRequirements:–FVCshallbecapableofcodingprogressivelyscannedvideosignals.
FVCmaysupportthecodingofotherscanningformats.
–FVCshallbecapableofrepresentingstillpictures.
–FVCshallbecapableofrepresentingvideosignalswithtemporalresolutionsrangingupto120fps.
FVCshouldbecapableofrepresentingvideosignalswithtemporalresolutionshigherthan120fps.
–FVCshallbecapableofrepresentingpicturesandvideosignalswithspatialresolutionupto8Kx4K.
FVCshouldbecapableofrepresentingpicturesandvideosignalswithspatialresolutionlargerthan8Kx4K.
–FVCshallbecapableofrepresentingpictureswithwidecolourgamutandhighdynamicrange(e.
g.
,ITU-RBT.
2100)aswellasconventionalcolourformats(e.
g.
,ITU-RBT.
709).
–FVCshallsupportpictureandvideoformatsofarbitrarysizeandtemporalsamplingrates,withinlimitsspecifictoeachoperatingconfiguration.
–FVCshallsupportatleastthesamerangeofprogressivescanpictureformatsandframeratesassupportedbyHEVC.
–FVCshouldsupportpanoramicpictureandvideoformats.
10PicturefidelityrangeRequirements:–FVCshallbecapableofoperationinaqualityrangefromlowfidelitiesuptosubjectivelyvisuallylossless.
–FVCshouldsupportamathematicallylosslessrepresentationofthevideosignal.
11Hierarchical/layeredcodingRequirement:–FVCshouldsupportextractionofdecodablesubsetsofabitstream.
Remark:Scalabilitymodalities(suchastemporal,spatial,andSNRscalability)canbeconsideredinafirstversionofafuturecodecspecification.
12SupportforAdaptiveStreaming–FVCshouldsupportrepresentationswitchinginthecaseofadaptivestreamingservicesthatoffermultiplerepresentationsofthesamecontent,eachhavingdifferentproperties(e.
g.
spatialresolutionorpicturefidelity).
–FVCshallenabletheuseofefficientpredictionstructureswithoutcompromisingfastandseamlessrepresentationswitchingcapabilitybetweenrepresentationsofdifferentproperties,suchasdifferentspatialresolutions.
13Possibleextensions–ExtensionsofFVCmayincludethefollowing:o3Dvideo.
oAdditionalscalabilitymodes.
oMulti-channeloperation,includingalphasupport.
oBitdepthsbeyond10bits.
oDistributedprocessingoperation.
oMultispectralimagery.