Combine sugar, cornstarch, and salt together in a saucepan. Slowly add milk while stirring. Bring to a simmer over low heat and cook for 5 minutes. Stir in vanilla extract and pour into four 1/2-cup custard cups. Refrigerate until thickened, about 1 hour.
