Other articles in the series include: 

How to Turn Music Data into Actionable Insights: This is an overview of the Data Pyramid and how it can be used in the music industry. 

An Overview of Data in The Music Industry: This article gives a list of all types of metadata in the music industry.

Making Sense of Music Data – Data Visualizations: This article explores data visualizations as the second step of the pyramid and gives examples of visualizations in the music industry. 

Benchmarking in the Music Industry – Knowledge Layer of the Data Pyramid: This article deals with Knowledge and how it is used to benchmark performance and set expectations.

Intelligence can be described as the ability to choose one decision out of a million other decisions based on knowledge of how these decisions might affect the outcome. 

Intelligence can be generated by the machine, for example, a self-driving car is a form of intelligence that scans the environment and can predict the course of action for the next section of the road. In the music industry, intelligent decisions are still, for the most part, made by humans by examining information, reading graphs and charts, memorizing past outcomes, and monitoring real-time data. In this article, we’ll explore some of the emerging intelligence technology in the music field so keep reading to find out more.

1. Recommendation systems that learn and adapt effectively to individual users’ preferences

Recommendation systems already use some sort of prescriptive analytics when they make a selection of songs based on past user behavior. Recommendation systems can also take into account the sequence of songs and context that affect the enjoyment level of the playlist as a whole. As previously played songs influence the perception of the next song, the playlist can be adjusted accordingly. The ability to prescribe a listening experience by recommendation systems is, perhaps, the most common and well-developed example of intelligence in the music industry.

Additionally, recommendation systems can prescribe music that directly affects user behavior. This project, for example, uses data from running exercises, predicts the future running performance, and recommends songs that maximize running results. It does so continuously, as the system stores and learns from each updated running exercise record.

To learn more about different types of recommendation systems, check out the article How Do AI Music Recommendation Systems Work. 

2. Automatic playlist generation based on context

Generating music or suggesting existing music based on the context is an analog of a self-driving car in the music industry. The music adapts to the listening situation to amplify the current experience. For instance in video games, where music adjusts to the plot as the user progresses through various levels of the game. More on that in our article on Omniphony engine that explores adaptive soundtracks and music context in game development.

Such systems are also used as location-aware music recommendations for travel destinations (when music is chosen based on the sightseeing place you visit), or computer vision systems for museum experiences (when the artwork dictates the audio choice). In these cases, the constantly changing environment serves as the basis for recommendations. 

Another example of intelligence in this field is generating music in the metaverse which is a virtual environment, that includes augmented reality. The metaverse can be accessed through Oculus headsets and a smartphone. Currently, virtual streams and concerts are already conducted in the metaverse, so it is only a matter of time till the curated immersive experiences that can adjust to the audience’s needs will be delivered using intelligence.

3. Prescriptive curatorship – What’s going to be hot next? 

Prescriptive curatorship entails an understanding of how up-and-coming artists and tracks will perform and who is more likely to break in the near future. In the past, platforms like Hype Machine indexed music sites and helped find the best new music. 

Nowadays, there are systems that can predict future hits and breaking artists automatically. For example, Spotify is developing algorithms that can predict future-breaking artists. The algorithm takes into account the preferences of the early adopters and then determines whether the artist can be considered breaking. This data can then be used to sign deals with the artist at a very early stage.

4. Tracking changes in music preference distribution  – making music that hits the current preferences or even future preferences

Unlike prescriptive curatorship that relies on a group of experts, music preference distribution numbers serve artists to show how their chosen genre and formats fit audience demographics and how music can be changed for current or future preferences. The general consensus in the music industry is that music preference algorithms come after the music is produced, otherwise all music will end up sounding the same to mimic popular artists. 

There is not yet a system that would automatically recommend changing the content of the song based on what users prefer. Nevertheless, attempts to use the numbers to create songs people will like are still being made.

5. Royalty Advances

Royalty advances are a complex task that requires comprehensive tracking of music consumption across all platforms. Distributors such as Amuse and iGroove offer a royalty advance service that is able to predict upcoming payout amounts so that artists can invest in their music long before the actual royalties kick in. These systems analyze streaming data to calculate upcoming earnings. 

Recently the topic got even more attention through the hype of NFTs. Crypto-investors want to predict future royalty payouts and the value of their asset. 

Future platforms most likely will be able to prescribe a course of action regarding which distribution platform to focus on based on the predicted royalty amounts. 

The main concern in the industry is how far can one go with technological intelligence considering that music is a creative activity and the human element is still largely prevalent. An intelligence machine that can tell which music to produce based on a prediction of future user preferences generally prompts an adverse reaction in the industry. 

Nevertheless, intelligent decisions to adjust the content of songs or to sign future-breaking artists identified by the AI can already be made by the artists and labels based on available data. 

At Cyanite, we provide our API for access to data and the development of any kind of intelligence engines. As always, at each level of the pyramid, the quality of data plays a vital role. Cyanite generates data about each music track such as bpm, dominant key, predominant voice gender, voice presence profile, genre, mood, energy level, emotional profile, energy dynamics, emotional dynamics, instruments, and more.

If you want to get the first grip on Cyanite’s technology, you can also register for our free web app to analyze music and try similarity searches without any coding needed.

How to Turn Music Data into Actionable Insights: This article is the first one in the series. It reviews all layers of the Data Pyramid and shows how to turn raw data into actionable insights. 

An Overview of Data in The Music Industry: This article presents all types of metadata in the industry from factual (objective) metadata to performance metadata. It is an essential guide for music professionals to understand all the various data sources available for analysis. 

Making Sense of Music Data – Data Visualizations: This article discusses the second step of the Data Pyramid – Information and how information can be presented in the form of data visualizations, making it easier to comprehend large data sets. 

At this step, attempts to look into the future and predict outcomes are made. The more specific the problem or context you’re observing is, the more precise your findings will be at this step. The Knowledge Layer produces analytics that help benchmark performance. As Liv Buli from Berklee Online University puts it, at the Knowledge layer you can tell that the artist of a certain size sells well after performing on the TV show and use this information to guide strategy for other artists of the same size. As a result, knowledge makes it possible to look at data in the industry-specific context and understand how you compare in relation to past successes and to competition. In that regard, benchmarking and setting expectations is the final outcome of the knowledge step. 

Benchmarking can take different forms within the music industry: 

Types of benchmarking 

• Process benchmarking

This type of benchmarking deals with processes and aims to optimize internal and external processes in the company. You can improve the process by looking at what competitors are doing or setting one process against another. Processes relate to how things are done in the company, for example, the process of uploading songs to the catalog. 

• Strategic benchmarking

Strategic benchmarking focuses on the business’s best practices which is often more complex than the other two types of benchmarking and includes: competitive priorities, organizational strengths, and managerial priorities. For example, an assessment of how fans responded to the brand sound in the past can help devise a long-term sound branding strategy.

• Performance benchmarking

Performance benchmarking compares product lines, marketing, and sales figures to determine how to increase revenues. For example, as a marketing campaign for a music release develops over time, it can reveal the most vital money channels for exposure. Sales figures can indicate how artists compare to one another in terms of profitability. 

1. Analyzing hit songs and popular artists to discover new talent

You can utilize Cyanite’s technology to analyze what’s currently working in the music industry in different markets. In particular, you can analyze popular songs and understand what makes them successful in terms of audio-based features such as genre, mood, energy level, etc. Further, you can use the Similarity Search to find tracks with a similar vibe and feel. It then helps you discover and identify new talent which may go along the same lines as current successes. Of course, that is not the whole story of making a hit but it gives you a pretty solid foundation of hitting the current zeitgeist.  

2. Analyzing popular playlists to predict matches

We specifically described this use case in The 3 Best Ways to Improve your Playlist Pitching with CYANITE article. You can analyze existing popular playlists such as Spotify New Music Friday or Spotify Peaceful Piano and see what songs are usually featured. This information can then help to understand the profile of the playlist which allows you to find the perfect fit and increase the chances of getting into the playlist. It also supports you in describing the songs to the editors in the way that song is accepted.  

3. Analyzing marketing and sales numbers to allocate marketing budgets and support event planning

For example, record labels can analyze the performance of their artists and adjust marketing campaigns accordingly. Insight can help change the direction of the marketing campaign, choose appropriate channels, and allocate marketing budgets more effectively. In events planning, you can analyze event venues and identify the most relevant cities and venues based on past events. 

4. Analyzing the artists’ styles to identify opportunities for song-plugging

If you’re a music publisher looking to get a placement on a new release of a successful artist, analyzing their previous style and matching it to your catalog of demos would be the way to go. 

In this case, some audio qualities of the song are not important, as it will be eventually re-recorded. To analyze songs, a regular Cyanite functionality can be used including the Keyword Search by Weights where you can search your demo-catalog by the analysis results of the successful artist on weight-specific keywords to get the most relevant results. 

5. Analyzing fan engagement to identify audience segments

You can also analyze artists’ performance by looking into fan engagement on social media and music platforms. Through understanding the fan’s demographics, interests, and lives, you can create custom audiences for new artists or deepen fan engagement for the same artist based on past campaigns. This use case has been thoroughly described in the article How to Create Custom Audiences for Pre-Release Music Campaigns in Facebook, Instagram, and Google.

6. Analyzing trending music in advertising to find the most syncable tracks in the own catalog.

Sync licensing which includes finding the sync opportunities and pitching specific songs can benefit from data analysis and benchmarking. Trending music in brand advertising can be analyzed to reveal the brand’s sound. This sound will then be matched to specific songs in your catalog making a strong case in the pitch to the brand in terms of sound-brand-fit. If you are interested in this use case and how data can be used in sound branding and sync licensing check out the interview we did with Vincent Raciti from TRO – About AI in sound branding.

– Knowledge is about the past, not the future. At the knowledge layer, you only have information about what happened before. Usually, information about the present (though some tools provide access to real-time data) or the future is not taken into account. It is important to remember this limitation as past performance is no guarantee to future results.

At the stage of Information, data is structured and organized so it can be interpreted. Information requires less time to find relevant data but there is still a lot of effort involved. 

At the Knowledge level, information is put into context and can be used for benchmarking and setting expectations. This context can be historical and involve past successes or it can relate to the position of others in the market. What kind of knowledge is derived from information depends on the initial data set and on the ability to store the memories of past successes. This process of turning data into knowledge takes a whole new form when machine learning and deep learning techniques are used as they significantly speed up the process of data collection and can memorize tons of data. However, a lot of knowledge in the music industry is still derived manually by looking at the past outcomes and trying to apply them somehow in the present.  

If you want to get the first grip on Cyanite’s technology, you can also register for our free web app to analyze music and try similarity searches without any coding needed.

This article is a continuation of the series “How to Turn Music Data into Actionable Insights”. We’re diving deeper into the first layer of the Data Pyramid and explore different kinds of metadata in the industry. 

Metadata represents a form of knowledge in the music industry. Any information you have about a song is considered metadata – information about performance, sound, ownership, culture, etc. Metadata is already used in every step of the value chain; for music recommendation (algorithms), release planning, advance payments, marketing budgeting, royalty payouts, artist collaborations, and etc. 

Nonetheless, the music industry has an ambivalent relationship with musical metadata. On the one hand, the data is necessary as millions of songs are circulating in the industry every day. On the other hand, music is quite varied and individual (pop music is very different to ambient sounds, for example) so the metadata that describes music can take different forms and meanings making it a quite complex field. 

This article intends to explore all kinds of metadata used in the industry from basic descriptions of acoustic properties to company proprietary data. 

The article was created with helpful input from Music Tomorrow:

There are various classifications of the music metadata. The basic classification is Public vs Private metadata: 

• Public metadata is easily available and visible to the public.  
• Private metadata is kept behind closed doors due to legal and security or because of economic reasons. Maintaining competitiveness is one of these reasons why the metadata is kept private. Typically, performance-related metadata like sales numbers is private. 

Another very basic classification of metadata is Manual vs Automatic annotations: 

• Manual metadata is entered into the system by humans. These could be annotations from the editors or users. 
• Automatic metadata is obtained through automatic systems, for example, AI.

1. Factual (Objective)

Factual metadata is objective. This is such metadata as artist, album, year of publication, and duration of the song, etc. Factual metadata is usually assigned by the editor or administrator and describes the information that is historically true and can not be contested. 

Usually, factual metadata doesn’t describe the acoustic features of the song. 

Besides the big streaming services, platforms like Discogs are great sources to find and double-check objective metadata. 

2. Descriptive (Subjective)

Descriptive metadata (often also referred to as creative metadata or subjective metadata) provides information about the acoustic qualities and artistic nature of a song. These are such data as mood, energy, and genre, voice, and etc.  

Descriptive metadata is usually subjectively defined by the human or the machine based on the previous experience or dataset. However, BPM, Key, and Time Signature are the exception to this rule. BPM, Key, and Time Signature are objective metadata that describe the nature of the song. We still count them as the descriptive metadata.  

Major platforms like Spotify and Apple Music have strict requirements for submitted files. Having incomplete metadata can result in a file being rejected for further distribution. For music libraries, the main concern is user search experience as categorization and organization of songs in the library rely almost entirely on metadata.

Companies such as Cyanite, Musiio, Musimap, or FeedForward are able to extract descriptive metadata from the audio file.

3. Ownership/Performing Rights Metadata

Ownership Metadata defines the people or entities who own the rights to the track. These could be artists, songwriters, labels, producers, and others. These are all sides interested in a royalty split, so ownership metadata ensures everyone involved is getting paid. Allocation of royalties can be quite complicated with multiple songwriters involved, songs using samples of other songs, and etc. So ownership metadata is important.

Companies such as Blòkur, Jaxta, Exectuals, Trqk, and Verifi Media provide access to ownership metadata with the goal to manage and track changes to ownership rights of the song over time – and ensure correct payouts for the rights holders.

4. Performance – Cultural Metadata

The performance or cultural metadata is produced by the environment or culture. Usually, this implies users having an interaction with the song. This interaction is then registered in the system and analyzed for patterns, categories, and associations. Such metadata includes likes, ratings, social media plays, streaming performance, chart positions, and etc. 

The performance category can be divided into two parts: 

• Consumption or Sales data deals with consumption and use of the item/track and usually needs to be acquired from partners. For example, Spotify shares data with distributors, distributors pass it down to labels, and so forth. 
• Social or Audience data. Social data indicates how well music/artist does within a particular platform plus who the audience is. It can be accessed either through first-party tools or third-party tools. 

First-party tools are powerful but disconnected. They require to harmonize data from different platforms to get a full picture. They are also limited in scope, meaning that they cover only proprietary data. Third-party tools are more useful. They provide access to data across the market, incl. performance for artists you have to connect to. In this case, the data is already harmonized but the level of detail is lower. 

Another way to acquire social data is tracking solutions (movie syncs, radio, etc) that produce somewhat original data — these could be either integrated with third-party solutions (radio-tracking on Soundcharts/Chartmetric, for example) or operate as standalone tools (radio monitor, WARM, BDS tracker). It is still the consumption data but it’s accessed bypassing the entire data chain.

5. Proprietary Metadata

Proprietary data is the data that remains in the hands of the company and rarely gets disclosed. Some data used by recommender systems is proprietary data. For example, a song’s similarity score is proprietary data that can be based on performance data. This type of data also includes insights from ad campaigns, sales, merch, ticketing, and etc. 

Some of the proprietary data belongs to more than one company. Sales, merch, ticket sales — a number of parties are usually involved here.

Today, processes in the music industry are rather one-dimensional when it comes to data. For instance, marketing budgets are often planned merely based on past performance of an artist’s recordings – so are multiples on the acquisitions of their rights. 

Let’s look at the financial sector: In order to estimate the value of a company, one has to look at company-internal factors such as inventory, assets, or human resources as well as outside factors such as past performances, political situation, or market trends. Here we look at proprietary data (company assets), semi-proprietary data (performance), and public data (market trends). The art of connecting those to make accurate predictions will be the topic of future research on the Cyanite blog.

Musical metadata is needed to manage large music libraries. We tried to review all metadata types in the industry, but these types can intersect and produce new kinds of metadata. This metadata can then be used to derive information, build knowledge, and deliver business insights, which constitute the layers of the Data Pyramid – a framework we presented earlier that helps make data-based decisions. 

In 2021, every company should see itself as a data company. Future success is inherently dependent on how well you can connect your various data sources.

Please contact us with any questions about our Cyanite AI via sales@cyanite.ai. You can also directly book a web session with Cyanite co-founder Markus here.

If you want to get the first grip on Cyanite’s technology, you can also register for our free web app to analyze music and try similarity searches without any coding needed.