Riding singlespeed offroad is a blast, so tracklocross should be fun, too. I think the challenge would be not being able to time your pedals for obstacles, and dismounting/remounting while the cranks are spinning will take a little practice. Post videos of your first ride!