you haven't misunderstood it at all, because you say that context must matter for decision making.
My argument is more than other disciplines, design is about empathising context and making decisions around that. A design system abstracts that process entirely and postulates pre-fabricated decisions. Now, depending on how that systems considers the designer-enduser relationship, it may already cover a wide variety of potential contexts. But it cannot cover everything
