The New York Yankees' losing streak stretched to four games after Monday night's 3-2 loss to the Baltimore Orioles at Oriole Park, a game that saw a late rally from the home team and left one infielder facing a long, anxious drive home.

Shortstop Jose Caballero, his right middle finger lightly wrapped, stood at his locker just 15 minutes after being caught stealing in the top of the ninth inning. "I think I'll be OK," he told reporters, clutching his car keys. But the injury, suffered on a pick-off throw at first base during Sunday's game, was clearly more than a minor annoyance.

Caballero had jammed the finger on his throwing hand in the ninth inning of Sunday's defeat, finishing that game in pain and hoping Monday would bring relief. While he could still hit and run the bases, making throws from shortstop was out of the question. With Max Schuemann filling in at shortstop, Caballero decided to stay with the team for Monday's game rather than head to New York early for medical attention. "I don't feel great right now, but whatever it takes to help the team," he said.

After showering, Caballero climbed into a rental car and began the nearly 200-mile drive up I-95 North and the Jersey Turnpike, a late-night journey from 10 p.m. until 1 a.m. He'll undergo an MRI and exam on Tuesday that will determine whether he lands on the injured list with a fracture or torn ligament. The outcome could have major implications for Scranton/Wilkes-Barre RailRiders shortstop Anthony Volpe, who would likely be called up if Caballero is sidelined.

The game itself was a heartbreaker. Left-hander Ryan Weathers carried a no-hitter and a 2-0 lead into the seventh inning, but the Orioles rallied when Coby Mayo homered with two runners on against reliever Brent Headrick, putting Baltimore ahead 3-2. The Yankees nearly clawed back in the ninth, with Paul Goldschmidt singling with two outs off rookie Anthony Nunez. Manager Aaron Boone inserted Caballero as a pinch-runner, but he was thrown out attempting to steal second, ending the threat.

This losing streak, which includes a shutout loss Friday and two walk-off defeats in Milwaukee over the weekend, has put the Yankees in a tough spot. For Caballero, the immediate focus is on his finger and that long drive ahead. For the team, the next few days could bring a roster shakeup—and perhaps a new face in the infield.