The full exploitation of the physics potential of the high luminosity LHC is a big challenge that requires new instrumentation and innovative solutions. We present here a conceptual design and simulation studies of a fast timing pixel detector with embedded real-time tracking capabilities. The system is conceived to operate at 40 MHz event rate and to reconstruct tracks in real-time, using precise space and time 4D information of the hit, for fast trigger decisions. This work is part of an R&D project aimed at building an innovative tracking detector with superior time (10 ps) and position (10 μm) resolutions to be used in very harsh radiation environments, for the ultimate flavour physics experiment at the high luminosity phase of the LHC.