Segmented Ranking

In Ansys Sound: Jury Listening Test, Segmented Ranking allows you to split the sound dataset into several groups of sounds. These groups are created according to the ranking of average ratings, but also take into account individual rating variability, and whether or not average rating differences are significant.

Two sounds therefore have a higher chance to be classified in two different groups if their average ratings are highly different and their individual rating variabilities are low.

In the graph below, you can see several groups of sounds, separated by vertical blue lines.

The segmented ranking in Ansys Sound: Jury Listening Test is based on a method that identifies groups of sounds (classes). It is a proprietary method that was empirically designed to detect scale points where strong differences exist between adjacent average ratings, with respect to their associated inter-individual differences. It starts from the p-values calculated from paired t-tests applied on every possible pair of sounds, but does not rely on any other existing standards. Its main principles are explained below:

  • Considering that sounds are sorted in ascending average rating order, two metrics and are evaluated based on the p-values calculated from paired t-tests between all possible pairs of sounds.
  • The metric is calculated as follows:
    • For each sound i, the p-values of tests with every sound with a lower average rating are summed (all sounds with index < i).
    • The metric for sound i is then the ratio between its p-value sum, and that of the previous sound (in ascending average rating order):
      Where denotes the p-value of the test between sounds i and k.
  • The second metric () is obtained with the same method, except this time only sounds with higher average ratings are considered when summing p-values:
  • For each distribution of values of these two metrics, quartiles Q1 and Q3 , and the inter-quartile range IQR are calculated. Then, sound i is considered as an outlier if either of the following two conditions is met:
  • The detection of each outlier marks a separation (also called a segmentation) between two sound groups.

In summary, you look at how significantly different, from a statistical standpoint, each sound is from sounds with lower average ratings on the one hand, and higher average ratings on the other hand. You then create a sound group separation when these statistical differences are much larger on average compared with the distribution of statistical differences between all sounds.

The figure below illustrates this. The selected sound (in pale orange) is displayed as not significantly different from 3 of the 4 other sounds with lower average ratings. However, if you look at this graph in its entirety, you cannot help but notice that the rightmost sound has a mean rating that noticeably departs from the trend followed by the previous four sounds (identified by the red dotted line). There is a 'break point' in the statistics of ratings at that particular sound. This is what the segmented ranking method is able to detect, and a segmentation mark (vertical blue line) is therefore created between this sound and the four sounds below it.