In multiple myeloma (MM), B cell maturation antigen (BCMA)-directed CAR T cells have emerged as a novel therapy with potential for long-term disease control. Anti-BCMA CAR T cells with a CD8-based transmembrane (TM) and CD137 (41BB) as intracellular costimulatory domain are in routine clinical use. As the CAR construct architecture can differentially impact performance and efficacy, the optimal construction of a BCMA-targeting CAR remains to be elucidated. Here, we hypothesized that varying the constituents of the CAR structure known to impact performance could shed light on how to improve established anti-BCMA CAR constructs. CD8TM.41BBIC-based anti-BCMA CAR vectors with either a long linker or a short linker between the light and heavy scFv chain, CD28TM.41BBIC-based and CD28TM.CD28IC-based anti-BCMA CAR vector systems were used in primary human T cells. MM cell lines were used as target cells. The short linker anti-BCMA CAR demonstrated higher cytokine production, whereas in vitro cytotoxicity, T cell differentiation upon activation and proliferation were superior for the CD28TM.CD28IC-based CAR. While CD28TM.CD28IC-based CAR T cells killed MM cells faster, the persistence of 41BBIC-based constructs was superior in vivo. While CD28 and 41BB costimulation come with different in vitro and in vivo advantages, this did not translate into a superior outcome for either tested model. In conclusion, this study showcases the need to study the influence of different CAR architectures based on an identical scFv individually. It indicates that current scFv-based anti-BCMA CAR with clinical utility may already be at their functional optimum regarding the known structural variations of the scFv linker.