Colored probably not racist but certainly derogatory and offensive which is why you wrote it. To use the term colored conjures up images of the times when there were signs pointing out "white" areas from the "colored" areas. Without the historical background it probably is not offensive but I have a feeling you used it to be offensive.