Bradford have been through much since their last try in Super League, Manese Manuokafoa scoring in a win over London Broncos in September 2014 with liquidation and reconstruction from the rubble.
But it was like they had never been away in the first exchanges, pushing back last year's Super League seventh placed side and scoring the first try through Waqa Blake, as the Fijian international burst through flimsy defence on six minutes.
The excellent Pryce produced a moment of magic to break through defensive lines and grubber kick as he was bring tackled for Joe Batchelor to level things up 10 minutes later but back came Bradford through ex-Hull FC back Connor Wynne.
Harvey Barron responded once again for the hosts who went 12-10 up with the help of Pryce's unerring boot before Davy Litten broke through some weak tackles on the left wing to make it 18-10 at half time.
If John Cartwright's side were hoping the Bulls would run out of steam in the second period they were swiftly disabused just six minutes into the second half, Rowan Milnes added the extras to give the visitors the lead.
Milnes added two converted penalty goals, the second of which came after a high tackle from Aidan Sezer on Joe Mellor on 61 minutes, which put Bradford into a slim 20-18 lead.
Eight minutes later, a penalty for Hull in front of the sticks was taken without hesitation, as Pryce levelled once again with 10 minutes to go.
Bradford had great field position from a goal-line dropout after a drop goal attempt from Milnes was charged down but a knock-on as they were rebuilding their attack took the wind from their sails.
Hull charged up the other end and, with three left on the clock, grabbed a point themselves; a pass back to Sezer shifted cleverly back again to Pryce and his kick sailed over from 30 metres out.
A lead of 21-20 with one minute to play looked fair but Cust added gloss to the scoreline in the final seconds.