The X-15 was launched from a B-52, its engines burned for 2 minutes or less, and the rest of its 10 or 20 minute flight, including landing, it was gliding.
The SR-71 took off under its own power, could be refueled multiple times, and was performing powered flight for however many hours its mission required.
Not even an apples-pineapples comparison.