CCCP Project Forums

Please login or register.

Login with username, password and session length
Advanced search  

Author Topic: Test Pilots Needed  (Read 13341 times)

Nicholi

  • Administrator
  • *
  • Posts: 1742
Test Pilots Needed
« on: August 03, 2006, 07:06:32 PM »
A new line of handy test files has been created by yours truly, aka "some hoser." The main reason for making these files is to make testing new CCCP builds, as well as other random decoders/splitters/filters/etc, extremely easy because all the formats are packaged together. Probably just for myself since all of you hosers are wierd, but I included all the formats I could here. I simply took the idea from the Manhole Test Your 5.1 sample and expounded upon it 1 million times. So some of these samples you might notice contain far more then you may ever think you need. However since they are all in Matroska it makes it quite easy to remux them removing any tracks you deem unnecessary. Which is why I decided to go overboard and include everything because it can be easily muxed out later. I also plan to make an extremely reasonable sized video format test file, as well as some other minor OGM/AVI/MP4 files with the various weird formats we have seen in each of them.

Just as well, so hopefully no one would want to kill me because of hueg like xbox'ness, I separated the samples into three testing grounds. This also had to technically be done because Haali's splitter will not activate on anything with more then 32 streams. The size of course was also an extremely large factor weighing on my mind n_n. There is an updated Manhole test file with these as well. For all 6ch audio streams I attempted to aim for 192kbps and 64kbps for 2ch sources. These seemed fairly reasonable bitrates to compress nearly as much as possible but keeping hearable output across all formats. The length of the samples was chosen to be around 1 minute in length in order to provide easy track switching without restarting the sample over and over, this of course also added to the somewhat large sizes, but screw you! They were good Macross Plus scenes.

If you can think of any formats which were missed and can point me to working encoders, let me know.

Manhole Test Your 5.1 Revamped
Mega Audio Test
Mega Weird Audio Test
Mega Lossless Audio Test


Manhole Test Your 5.1 Revamped - 23.7MiB
For a modest 5MiB increase in size three more formats were added to the original and the MP3 track was removed because there is no DirectShow decoder capable of producing the 6ch output. The purpose of this file is to test the major formats which are capable of 6ch output, as well as those explicitly supported in the CCCP which can use 6ch. The main focus as I see it is for Monkeys who need help setting up their multichannel speaker systems. With audio discretely going to each speaker it makes it quite easy to test downmixing options. Also the file is of a very manageable size and can double for very simple decoding tests.

Contains:
DTS - 768kbps
Dolby Digital ATSC A/52 - AC3 Source
MPEG-4 LC-AAC
MPEG-4 HE-AAC
Vorbis
WMA10 Pro
RealAudio 8 Cook
FLAC
TrueType Audio
WavPack Lossless


Mega Audio Test - 76.2MiB
If any of the Mega tests are important, this is the one. It contains all of the major MPEG formats along with AC3, DTS, and Vorbis. Essentially holding the most commonly used audio formats in every various form I could possible encode them in as well as 6ch and 2ch when possible, which probably sends off the "Nicholi is crazy warnings." There are only a few slight samples here where I deviated from my 64kbps for 2ch sources rule, in the ancient MPEG-1 codecs. For MP1 I started at 192kbps and lowered it to 128kbps for MP2 and finally 64kbps for MP3. Fairly interesting comparisons all in all.

The MPEG-2 LSF Layers refers to the Low Sampling Frequencies technology implemented by MPEG to allow for half samplerates (16-24 kHz) and bitrates as low as 8kbps. MPEG-2.5, which also uses LSF, was created as a non-standard extension of MPEG-2 by Fraunhofer-Gesellschaft which allows for even lower samplerates (8-12 kHz). The FhG 6ch MP3 sample was placed here to simply keep it around.

Contains:
Dolby Digital ATSC A/52 - 448kbps, 192kbps - AC3 Source
DTS - 1536kbps, 768kbps
Vorbis - 194kbps, 64kbps
MPEG-1 Layer 1* - 192kbps
MPEG-1 Layer 2* - 128kbps
MPEG-1 Layer 3 - 192kbps, 94kbps
MPEG-2 LSF Layer 1* - 128kbps
MPEG-2 LSF Layer 2* - 96kbps
MPEG-2 LSF Layer 3* - 70kbps
MPEG-2.5 LSF Layer 3* - 64kbps
MPEG-2 AAC LC - 202kbps, 66kbps
MPEG-2 AAC Main - 193kbps, 66kbps
MPEG-4 AAC LC - 199kbps, 65kbps
MPEG-4 AAC HE - 200kbps, 65kbps
MPEG-4 AAC HEv2* - 32kbps
MPEG-4 AAC LTP - 195kbps, 67kbps
MPEG-4 AAC Main - 202kbps, 65kbps
* Only 2ch sample provided either from limitation of format or available encoders.
External Subtitles Available.

Does not contain:
MPEG-2 MC Layer 2 - Two encoders available, MPEG reference and one created by Philips. Impossible to get output which even seems to work with their respective decoders.
MPEG-2.5 Layer 1-2 - Probably never implemented by anyone since MP1/2 encoders are so last century n_n.
MPEG-2/4 AAC SSR - Only software available is reference software which is incredibly difficult to compile.
DTS 44.1 kHz 1234kbps - Not recognized by any MKV matroska muxers.


Mega Weird Audio Test - 46.8MiB
The name of this test says it all. This test is composed of the most off the wall formats and specialized encoders no one is ever likely to use but will all fit into Matroska. It was quite interesting just tracking down all of the old RealAudio codecs. Many could not be included because of the limitation of either the Matroska specifications or not yet implemented (likely never will be) into mkvmerge or other Matroska muxers. The ones which can not be muxed I will link below, all of which are RealAudio formats. Fun note about Real: they have only created 1 audio codec ever, Cook. Otherwise they have always packaged some other standard format into their nasty container :P.

Important Note in switching tracks. Mostly from incomplete splitter support, you cannot directly switch from one Windows Media track to another Windows Media track (almost the same for Real Media as well with a few details changed). For Real Media this only concerns switching to tracks with a different channel count, i.e. from mono to stereo, or stereo to 6ch, etc. Also you cannot switch from a track using a Real decoder to RealAAC (or RealAAC+ which are both decoded with ffdshow) for some reason. Improper Real switching will simply close the player. For WMA you cannot switch from any track to another that uses Windows Media decoders. Unlike Real it will only stop playback, which can be fixed by switching to a non-WMA track and hitting play again. So in order to avoid this madness just switch to a track of another type then back to the one you want to.

Contains:
Dolby Digital ATSC A/52 - 448kbps, 192kbps - AC3 Source
Aud-X HGHQ MP3 - 6ch Only - 192kbps - Dolby ProLogic II compatible.
Aud-X SPBQ MP3 - 6ch Only - 192kbps - Reverts to Mono output without Aud-X decoder.
ACELP Sipro* - 16kbps
MS ADPCM* - 90kbps
IMA ADPCM* - 90kbps
Yamaha ADPCM* - 64kbps
G.726 ADPCM* - 32kbps
G.711 CCITT μ-Law* - 128kbps
G.711 CCITT A-Law* - 128kbps
MS GSM 6.10* - 64kbps
DSP Group TrueSpeech* - 8kbps
WMA7* - 64kbps
WMA8* - 64kbps
WMA9 Voice Mono* - 20kbps
WMA9.2 Standard* - 64kbps
WMA9.1 Pro - 192kbps, 82kbps
WMA10 Pro - 192kbps, 64kbps
WMA9.1 Lossless - 1884kbps, 776kbps
RealAudio 6 (G2) Cook* - 64kbps
RealAudio 8 ATRC* - 66kbps - Sony ATRAC inside RealMedia.
RealAudio 8 Cook - 184kbps, 64kbps, 32kbps
RealAudio 10 RealAAC* - 64kbps - MPEG-4 LC-AAC inside RealMedia.
RealAudio 10 RealAACplus* - 64kbps - MPEG-4 HE-AAC inside RealMedia.
* Only 2ch or lower sample provided either from limitation of format or available encoders.
External Subtitles Available.

Does not contain:
Creative ADPCM - FFMPEG is a bitch to figure out with no fucking documentation. I dare you to encode some CT ADPCM n_n.
QDesign Music Codec - Cannot find encoder and most likely will not mux to Matroska anyways, also no DirectShow decoder.
QDesign Music Codec 2 - Though there is an incomplete DirectShow decoder it cannot be muxed to Matroska with mkvmerge.
RealAudio 1 lpcJ (14_4) - IS-54 VSELP inside RealMedia. Part of the Matroska specs but no way to get inside Matroska n_n.
RealAudio 2 28_8 - ITU-T G.728 inside RealMedia. Part of the Matroska specs but no way to get inside Matroska n_n.
RealAudio 3 DNET - ATSC A/52 (AC3) inside RealMedia. Not part of Matroska specs.
RealAudio 5 Sipro - ACELP Sipro inside RealMedia. Part of Matroska specs however only seems to result in complete garbage when muxed.
RealAudio Lossless Format - Part of the Matroska specs but no way to get inside Matroska n_n. Just as well it seems completely unable to play within DirectShow with Gabest's splitter. I have only been successfuly playing the file in RealPlayer.
WMA1-6 - No idea where to locate such encoders.
WMA9.2 Lossless - I decided to specifically not include this one because it wasn't compressing shit! Whereas 9.1 seemed to be doing its job correctly.


Mega Lossless Audio Test - 100.6MiB
One of the largest reasons to separate the tests, or there simply would have been no lossless samples. Holds all three major lossless formats supported by Matroska, in both 6ch and 2ch. WavPack also comes in its multiple flavors to assure decoding works correctly for each type. WMA and RealAudio Lossless were kept with their entourages for less confusion.

Contains:
Dolby Digital ATSC A/52 - 448kbps, 192kbps - AC3 Source
FLAC - 2158kbps, 892kbps
TrueType Audio - 2343kbps, 854kbps
WavPack Lossless - 1982kbps, 822kbps
WavPack Hybrid
WavPack Lossy - 641kbps, 219kbps
« Last Edit: April 17, 2008, 03:25:58 PM by movax »
Logged

Keeper of Demons

  • DirectShow Mage
  • *****
  • Posts: 1074
Test Pilots Needed
« Reply #1 on: August 04, 2006, 02:01:42 AM »
Woah ! You sure are crazy ! ^^

Just to be a nitpicker, though, Dolby Digital AC3 is a lossy audio format and not a lossless one. ^^;

Btw, could APE be placed in a matroska container ?
Logged

Nicholi

  • Administrator
  • *
  • Posts: 1742
Test Pilots Needed
« Reply #2 on: August 04, 2006, 11:42:41 AM »
Nope APE can't go in Matroska, yet. The only formats I missed which are part of the Matroska specs are:
MPC - Supposedly not finalized yet.
QDMC1/2 - Some weirdo Quicktime codecs, no idea where to get them.
Otherwise I can attempt to sneak anything in through ACM wrapping, which should work in most cases.

By the by I am fully aware AC3 is a lossy format. I just included the "source" audio in each version. Thus also why it is in Mega Weird Audio, etc.
Logged

Myrsloik

  • Administrator
  • *
  • Posts: 103
Test Pilots Needed
« Reply #3 on: August 04, 2006, 06:10:25 PM »
I doubt the matroskians will ever add ape as it doesn't seem to offer anything you can't already do with wavpack.
Logged

check

  • Administrator
  • *
  • Posts: 3275
  • Part 8
    • WWW
Test Pilots Needed
« Reply #4 on: August 05, 2006, 03:58:14 AM »
You added both AACLC and AACHE to the new manhole file - why didja do this? Surely as they are decoded with the same thing, there have never been any differences with LC and HE decoding, HE is a superset of LC features, <more reasons> you may as well scrap one of them?

Secondly, I'm almost positive I used to have an aac encoder that supported he-aac as MPEG2. I'm reasonably sure it was a hacky winamp-dll-using CLI thing, I'll try to find it. EDIT: have fun: http://forum.doom9.org/showthread.php?t=102942
Logged
When asking for help, please do the following:
Download the CCCP Insurgent and:
0. Rclick the video in MPC -> list everying shown under 'Filters'
1. Tools > Test Render > "problem file"
2. Tools > Media Information > "problem file"
3. Tools > CRC Check > "problem file"
4. File > Save Log > Paste the output here.

Nicholi

  • Administrator
  • *
  • Posts: 1742
Test Pilots Needed
« Reply #5 on: August 05, 2006, 10:57:19 AM »
Oh how young you are checkers to have not known the multitude of AAC decoder problems in the past. Lots of incorrect detection of HE and LC audio. These are the two most popular AAC object types and I think it just makes sense to add them. Besides the HE file is so extremely small it hardly makes a size difference.
Logged

check

  • Administrator
  • *
  • Posts: 3275
  • Part 8
    • WWW
Test Pilots Needed
« Reply #6 on: August 05, 2006, 09:57:06 PM »
Well, I know there used to be squillions of problems (zx.nfos attest to this), but since ffdshow/libfaad pretty much treats them as one and the same now adding two is pretty redundant. However compared to the overall filesize I guess the difference is minimal so I guess I won't argue te point further :P.

..and no thanks for the MPEG2AAC enc!
Logged
When asking for help, please do the following:
Download the CCCP Insurgent and:
0. Rclick the video in MPC -> list everying shown under 'Filters'
1. Tools > Test Render > "problem file"
2. Tools > Media Information > "problem file"
3. Tools > CRC Check > "problem file"
4. File > Save Log > Paste the output here.

Nicholi

  • Administrator
  • *
  • Posts: 1742
Test Pilots Needed
« Reply #7 on: August 06, 2006, 01:26:04 AM »
Took me awhile to figure it out..SANKKK YOUU CHECKERS-SAN!!!!!!11

Updated Flight Schedule
The following formats will be added to Mega Weird Audio Test, or might bleed over into a new file. Haven't really worked out the number of tracks yet, but I'm sure its going to run over 32.

MS GSM 6.10*
G.711 CCITT A-law*
G.711 CCITT μ-law*
QDesign Music Codec 2* (Actually might not make it because the DShow decoders don't work at all, and all though MKVmerge accepts it as input, it muxes a file with nothing in it :( )
DSP Group TrueSpeech*
G.726 ADPCM*
Yamaha ADPCM*
MPEG-2 AAC HE
MPEG-2 AAC HEv2* (Yes you heard it. SBR+PS on MPEG-2, wtf^m)

Still looking for QDesign Music Codec version 1 (only other real format officially part of Matroska specs not in the Tests), though might be impossible to find. Also going to rencode the IMA and MS ADPCM, as it seems I foolishly left them at a very high bitrate. Thus they may sound quite awesome :), for now.
Logged

Keeper of Demons

  • DirectShow Mage
  • *****
  • Posts: 1074
Test Pilots Needed
« Reply #8 on: August 06, 2006, 04:13:13 AM »
Check your PM Nicholi. I don't know if it has what you're looking for, maybe that QDesign MPEG Layer 1 codec is actually your QDesign Music 1. I'm not posting the link in this post because the server is nasty - it only allows for a limited number of downloads per day and after that it displays a "Service not available" or something similar. Anyway, it's a monstrous codecs archive.
Logged

Nicholi

  • Administrator
  • *
  • Posts: 1742
Test Pilots Needed
« Reply #9 on: August 07, 2006, 12:29:19 AM »
Final Flight Schedule with minor additions in the future
Updated Mega Weird Audio Test. Didn't bother to change filename since it's not that important. About 1mb smaller but 6 new tracks added, hurrah! It is also now at 31 tracks, so it can only have 1 more if I think of anything. Unlikely that anything will be changed at this point, since it is a lot to upload for a single track change.

Also updated the other tests for relative track bitrates. I think I'll be adding the MPEG-2 HE(v2) samples in a separate new test somewhere. Since the main Mega Test is full and I don't want to disturb its pristine shiny'ness by removing other tracks to fit these in. Perhaps the new file will be called the Mega Small Audio Test, lawls bawls. All new things can go there if any exist.
Logged
 

Page created in 0.133 seconds with 13 queries.