search

blenderMoE (Mixture-of-Experts)

MoE Overviewchevron-rightMoE ๋ชจ๋ธ ๋น„๊ต ๋ฐ ์ฃผ์š” ๊ธฐ๋ฒ• ์ •๋ฆฌchevron-right๋ถ„์‚ฐ ํ›ˆ๋ จ ๊ธฐ์ดˆ ๊ฐœ๋…chevron-right์ „๋ฌธ๊ฐ€ ๋ณ‘๋ ฌํ™” (Expert Parallelism)chevron-right[Optional] NVSHMEM (NVIDIA Shared Memory)chevron-right๋ถ„์‚ฐ ํ›ˆ๋ จ์—์„œ์˜ AWS ๋„คํŠธ์›Œํ‚น: EFA (Elastic Fabric Adapter)chevron-rightAWS์—์„œ MoE ๋ชจ๋ธ์„ ํšจ์œจ์ ์œผ๋กœ ํ›ˆ๋ จํ•˜๊ธฐchevron-right๋ถ„์‚ฐ ํ›ˆ๋ จ ์ „๋žตchevron-rightML ์—”์ง€๋‹ˆ์–ด์™€ ์ธํ”„๋ผ ์—”์ง€๋‹ˆ์–ด ๊ฐ„ ๋ถ„์‚ฐ ํ›ˆ๋ จ ํ˜‘์—… ๊ฐ€์ด๋“œ ๋ฐ ์ฒดํฌ๋ฆฌ์ŠคํŠธchevron-right์ถ”๋ก  ์ตœ์ ํ™” ๊ฐœ์š” (Prefill๊ณผ Decoding์— ๋”ฐ๋ฅธ ์ฃผ์š” ๊ธฐ๋ฒ• ์ •๋ฆฌ)chevron-rightSageMaker Large Model Inference (LMI)๋ฅผ ํ™œ์šฉํ•œ ๋ชจ๋ธ ์„œ๋น™ ๋ฐ ์ตœ์ ํ™” ๊ฐ€์ด๋“œchevron-right
Previous[Use-case w/ Hands-on] ์‹ค์ œ ๋ฐ์ดํ„ฐ๋กœ๋ถ€ํ„ฐ ํ•ฉ์„ฑ QnA ์ƒ์„ฑํ•˜๊ธฐNextMoE Overview