Kelce, 34, attended the World Series Game 1 in Texas on Friday

Travis Kelce attends the Los Angeles Premiere Of Netflix's "Quarterback"; Taylor Swift attends 'In Conversation With... Taylor Swift' during the 2022 Toronto International Film Festival

Travis Kelce and Taylor Swift. PHOTO: JC OLIVERA/GETTY IMAGES; AMY SUSSMAN/GETTY IMAGES

Travis Kelce is shaking it off!

The Kansas City Chiefs player, 34, was spotted busting some moves to Taylor Swift’s 2014 song “Shake It Off” amid his new romance with the singer, as he attended the World Series Game 1 between the Texas Rangers and the Arizona Greenbacks in Arlington, Texas on Friday. Later in the evening, the tight end was also seen dancing to a different Swift tune at a bar!

In a TikTok clip posted by an attendee at the baseball game, Kelce appeared on the big screen at Globe Life Field stadium, where the World Series game was held, as he danced to the track in his seat in the stands.

Although Swift was not with him at the game, Kelce smiled as he held one arm up while shaking his hand and laughing as “Shake It Off” played in the fun video

Travis Kelce and Jason Kelce attend a game before the game against the Boston Celtics against the Philadelphia 76ers during Game 6 of the 2023 NBA Playoffs Eastern Conference semi-finals on May 11, 2023 at the Wells Fargo Center in Philadelphia, Pennsylvania

Travis Kelce and Jason Kelce attend the Boston Celtics against the Philadelphia 76ers during Game 6 of the 2023 NBA Playoffs Eastern Conference semi-finals on May 11, 2023 at the Wells Fargo Center in Philadelphia, Pennsylvania.JESSE D. GARRABRANT/NBAE VIA GETTY

In another clip shared by a different TikTok user, Kelce danced again to Swift in a bar as her 2008 song “Love Story” played. The fun moment was captured as the tight end attended what appeared to be a post-match party with friends following the Rangers’ win against the Diamondbacks in the World Series game.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

The NFL star was spotted chatting with friends before he began jumping up and down to the song and mouthing along to the words, in between laughing and sipping on a bottle of champagne.

In a separate video from the same bar, shared on X (formerly known as Twitter), Kelce even appeared to be taking a selfie video of himself as he danced along to “Love Story.”

Kelce’s appearance at the World Series game comes as a source told PEOPLE this week that his romance with Swift appears to be “getting serious.”

Travis Kelce attends the 2022 ESPYs; Taylor Swift attends the 2023 MTV Video Music Awards

Kelce and Swift’s romance is hotting up.ALBERTO E. RODRIGUEZ/GETTY IMAGES; KEVIN MAZUR/GETTY IMAGES

On Friday, an insider shared of the pair’s romance: “It’s quickly turning more serious. They share a strong work ethic and have a huge appreciation for life and their careers, strong family bond and values.”

They also described Kelce as “sweet, goofy and just a blast to be around.”

Rumors of a romance between Kelce and Swift were first sparked last month after the “Cruel Summer” singer was first spotted cheering the tight end on at a Chief’s game on Sept. 24., before the pair left together.

Swift has since attended a few games in support of Kelce, including last Sunday’s Kansas City Chiefs winning match against the Los Angeles Chargers at Arrowhead Stadium.

Travis Kelce attends the 2022 ESPYs at Dolby Theatre on July 20, 2022 in Hollywood, California

Kelce was in happy spirits at the game as he attended solo.LEON BENNETT/GETTY

The day after, the singer stepped out with Kelce for dinner at the Argentine steakhouse Piropos in Missouri, in photos obtained by Daily Mail.

Swift was described as “a very, very sweet, very charming, down-to-earth young woman” by Kelce’s dad, Ed Kelce, who spoke with PEOPLE after the game on Sunday.

“I’ll tell you something very special that I noticed about Taylor the first time I met her,” Ed, who joined Swift in a suite during the game at Arrowhead Stadium on Oct. 12., said of the singer.

“We’re sitting in the suite, she gets up and in the front room, she gets up to go get a drink or something and she starts picking up empty bottles, cans, plates that are scattered around. Because in the suites everybody gets stuff and you empty it down wherever you can.”

Ed continued, “And I’m just thinking, I don’t think she got the diva memo. She didn’t get the spoiled musician. She doesn’t know how to pull that off. And that really to me said a whole lot.”