As long as you don't over or under charge the lithium cells you will be fine. I had a disaster with my Prius booster pack to my lead acids. Prius cells over charged. I did not have a smart charger which would be important in the case of using different batteries. Lithium charge is nearly the same as lead acid except the balancing cycle and float cycle.
You going to use a lithium charger or lead acid charger?
You going to use a lithium charger or lead acid charger?