--- title: "How CueFlip listens: from sound to page turn" description: "An illustrated look at how CueFlip hears a performance, finds its place in the sheet music and turns the page, including what happens when it loses its place." url: "https://cueflip.com/blog/how-cueflip-listens/" language: "en" --- 15 October 2026 [Research](https://cueflip.com/blog/?category=research) # How CueFlip listens An illustrated tour of what happens between a musician playing and a page turning: how CueFlip hears the music, finds its place in the score, and what it does when it loses it. By CueFlip Team 4 min read ![Purple poster with the word CueFlip set large in cream letters, a staff of note names between the two halves, and thin field lines curving around it.](https://cueflip.com/blog/media/1i22fb5iwd4neeremw2b/v1-1200.webp) CueFlip is an automatic page turner for iPad and iPhone. The technique behind it is called score following: listening to a live performance and keeping track of where it is in the sheet music. This post walks through how that works, one picture at a time. ## A machine that listens In 1774, the Swiss watchmakers Pierre Jaquet-Droz, his son Henri-Louis and Jean-Frédéric Leschot presented The Musician, an automaton that played a real organ with its fingers. It could play, but it could not hear. CueFlip is the other way round. It plays nothing. It listens. ![Poster in brown and pale blue titled 'The machine behind the musician': a figure made of small typographic marks and horizontal bars, an illustration of a machine that listens.](https://cueflip.com/blog/media/o5724mnz4i2q451t4xdp/v1-1200.webp) It does not read the notation on the page. It learns how one particular piece sounds when you play it, and then recognises that sound again while you perform. ## Learning the piece once In Learn, you play the piece through once, or import a recording of it, and mark where the pages turn. That recording is the reference. Everything that follows is a comparison between what you are playing now and what you played then. ## What it hears A recording holds far more than is needed to find a place in a piece. CueFlip keeps two things from it. The first is which note names are sounding, moment by moment. A note counts under its name whatever octave it is played in, so playing an octave higher or lower should matter less. A different room or instrument can still affect how well CueFlip follows. ![Blue poster with a white panel in which each note name forms a column of letters, the columns twisting together like a double strand through half a minute of music.](https://cueflip.com/blog/media/trwktra89k709eyx4b4r/v1-1200.webp) Each trace in the picture is one note name followed through half a minute of music: letters for the white keys, dots for the black ones. The ribbon twists where the harmony changes, and the strongest notes are drawn bold. It is a drawing of how a piece looks to the engine, not a picture of a score. ## When, as well as what Note names say what is sounding. They do not say when something began. For that, CueFlip splits the sound into bands, from the lowest notes to the brightest overtones, and watches each band for the moment something starts: a bow, a string, a hammer. ![Dark green poster of nested frames with scattered green dots and the words Mirror and Pulse, standing for the bands in which CueFlip watches for the start of each note.](https://cueflip.com/blog/media/wqmgbwzf27111tdk6rss/v1-1200.webp) Together the two give it a short description of every instant of the performance, which it can hold up against the reference. ## Finding the place You will not play at the speed of your reference. You speed up, you linger, you breathe. So the engine does not compare the two moment by moment. It looks for the best path through all the ways the two could line up, and lets that path bend to follow your tempo. ![Dark poster of a diamond made of halftone dots, with an orange line running down its middle and dashed lines on either side.](https://cueflip.com/blog/media/67l6leibgfc8amfmgrlp/v1-1200.webp) The path is not allowed to wander freely. In the picture, the orange line is the path and the dashed lines mark how far from the middle it may stray. A path that jumps around is more likely a mistake than a musician. ## When it loses its place Music repeats. When a section comes round a second time it sounds the same, and for a moment the engine has two honest answers: here, or there. You know which one is right. The engine has to work it out. ![Blue-grey poster titled 'Two paths, one place in the score': a double helix of numbered beads that opens where two readings of the score disagree and closes again.](https://cueflip.com/blog/media/mmm1h55an5fyynzofxd7/v1-1200.webp) Sometimes it picks the wrong one, and the position it reports drifts away from where you really are. As a guard, CueFlip keeps two readings of your place: one that follows the performance closely, and one that keeps the whole piece in view and moves more slowly. The picture draws them as the two strands of a helix. When they agree, the strands run close together. When they disagree, the helix opens. In this example the performance goes back to a passage it has already played. For a while both readings carry on as if nothing had happened. The close follower notices first and relocates. The one watching the whole piece corrects itself a little later, and the strands wind together again. This is the hardest part of the job, and CueFlip does not always get it right. When it is not sure, it holds back instead of turning a page on a guess, and you can always turn the page yourself. ## Turning the page A performance is never exactly as long as the take you learned from. In the last picture, the line on the left is the performance itself, here played slower than the learned take, running from top to bottom. The spiral on the right is the score, wound into a scroll. Every thin line joins one moment of the performance to the place in the score where the engine believed it was at that moment. ![Dark poster: a vertical line of timed markers on the left and a spiral scroll on the right, joined by many thin lines, with five orange lines marking the page turns from page 2 to page 6.](https://cueflip.com/blog/media/rj980xndo2za9ppca7gw/v1-1200.webp) The five orange lines are the page turns. Each one starts at the moment in the performance when CueFlip turned the page, and ends at the point in the learned take where you marked that turn. CueFlip turns the page a little before you reach the place you marked in Learn, so the next page is already there before your eyes need it. ## Where this happens All of this runs on your iPad or iPhone. The sound is analysed as you play and is not sent to CueFlip. There are no accounts and no tracking. If you turn on iCloud sync, it uses your own iCloud. That is the whole idea: learn the piece once, listen, find the place, turn the page. The rest is care, and a great deal of testing with real players, who rarely play exactly as written. --- CueFlip is a sheet music reader for iPad and iPhone that listens as you play and turns the page for you — no pedal, no timer. Import your own PDF scores; free to start. [Download on the App Store](https://apps.apple.com/app/id6797384070) · [https://cueflip.com/llms.txt](https://cueflip.com/llms.txt)