Lychee trees are best planted at least 30 feet away from your home, other major structures, or other trees in your home landscape. Planting them too close can impact their growth and fruit harvest, particularly if they are shaded. If you are in an area prone to flooding, planting the tree on a mound of soil can help to ensure water runoff. Plant a lychee tree in a full sun location that is protected from wind, because this tree can be susceptible to wind damage. Spring planting, after any frosts have passed is best.HOW TO GROW LYCHEE PLANT? Lychee can be maintained as small patio trees in warmer climes or grown into 35- or 40-foot trees in the ground. In pots, the plants should be repotted every spring until they reach your maximum growing size. To help keep the plant smaller, aggressively prune the main growing trunks annually to encourage a smaller, bushier plant.