The American singer was eliminated from the show after being the slowest to complete a puzzle during a challenge