But when I came unto my beds . . . / With toss-pots still had drunken heads . . . The previous three stanzas say that life gets more serious as you get older, and the next one seems to suggest that nothing really matters in any case. How this stanza fits in is hard to say. The sentence doesn't really make sense, but maybe it suggests that the fool didn't learn his lesson about life, that when he grew up he still hung around with drunkards and mischief-makers.