Collison, Myles Turner and Domantas Sabonis added 15 points apiece, and Thaddeus Young had 10 for the Pacers, who were playing without Tyreke Evans.
The post-LeBron era is off to a rigid start as the team is now 0-4 and fans have nothing to actually cheer for anymore.
Drummond - who was ejected in the win over the 76ers - had 20 points and 20 rebounds through three quarters against Cleveland.
IN (4-2) placed six players in double figures.
Bojan Bogdanovic had 25 points and combined with Oladipo to hit 20 of their 29 shots, helping IN win a second straight game for the first time this season.
The teams met for the first time since Cleveland defeated IN in the first round of the Eastern Conference playoffs last season. "We haven't really been as good as we should be at this point with just executing". Cleveland was coming off a 133-111 loss in its home opener to the Hawks.
Ross kept the Magic within striking distance with 12 points on 5-for-7 shooting. Oladipo and Bogdanovic hit 3-pointers, and Collison knocked down a jumper from the corner and scored in the lane, to lead 81-66.
Cleveland trailed just 97-91 after a Jordan Clarkson 3-pointer with 9:17 remaining before the Pacers countered with an eight-point flurry, with Darren Collison providing two of the four baskets.
Nets forward Rondae Hollis-Jefferson and guard Shabazz Napier made their season debuts.
The Nets broke a 10-game losing streak in Cleveland and won for the first time at Quicken Loans Arena since April 3, 2013. Six players average in double figures and two others scored nine points a game.
The Celtics looked sharp in the first quarter, which concluded with the visitors holding a 30-21 lead.
The Pistons haven't gone undefeated through their first four games since the 2008-09 season.
The Cavaliers cut the margin to six with 49 seconds left in the fourth when Korver made a 3-pointer while being fouled for a four-point play.
"I know he's going to be out today", coach Tyronn Lue said before the game. "If we're open for the 3, we have to let it go".