?꾩떖 ?섍꼍?먯꽌??吏㏐퀬 媛뺥븳 寃쎄퀬?뚯씠 鍮좊Ⅴ寃?吏?섍컩?덈떎. ?몄? 吏?곗? 諛붾줈 ?덉쟾 臾몄젣濡??댁뼱吏????덉뒿?덈떎.
Code Fair 2024
泥?컖 ?μ븷??寃쎈낫 ?쒖뒪??/p>
寃쎌쟻, ?ъ씠?? 釉뚮젅?댄겕?뚯쿂???대룞 以??볦튂湲??ъ슫 ?꾪뿕 ?뚮━瑜??ㅼ떆媛꾩쑝濡?媛먯??섍퀬, ?대? ?쒓컖 以묒떖 寃쎄퀬 ?붾㈃?쇰줈 ?꾪솚????鍮좊Ⅴ寃??곹솴???몄??????덈룄濡??ㅺ퀎??AI ?덉쟾 蹂댁“ ?쒖뒪?쒖엯?덈떎.
Overview
SafeRide??泥?컖 ?μ븷?몄쓽 ?대룞 ?섍꼍??湲곗??쇰줈 ?ㅺ퀎??寃쎈낫 ?쒖뒪?쒖엯?덈떎. 釉뚮씪?곗?媛 留덉씠???낅젰??諛쏆븘 audio/webm 泥?겕濡??꾩넚?섍퀬, Python ?쒕쾭媛 ?대? 16kHz ?⑥씪 梨꾨꼸濡?蹂?섑븳 ?? TensorFlow Hub??YAMNet 紐⑤뜽濡??꾪뿕 ?뚮━瑜?遺꾨쪟?⑸땲?? 媛먯? 寃곌낵???ㅼ떆 WebSocket?쇰줈 諛섑솚?섏뼱 ?붾㈃ 寃쎄퀬, 濡쒓렇, ?곹깭 蹂?붾줈 利됱떆 ?꾨떖?⑸땲??
Design Draft
?ㅼ젣 援ы쁽???ㅼ뼱媛湲??? SafeRide???붾㈃ ?먮쫫怨?二쇱슂 ?붿냼瑜?癒쇱? ?뺣━??珥덇린 ?ㅺ퀎?덉엯?덈떎.
Problem
?대룞 以?寃쎄퀬???ㅻ챸蹂대떎 癒쇱? 蹂댁뿬???⑸땲?? SafeRide???ㅻ━吏 ?딅뒗 ?꾪뿕???쒓컖 以묒떖 ?명꽣?섏씠?ㅻ줈 踰덉뿭?섎뒗 ??吏묒쨷?덉뒿?덈떎.
?꾩떖 ?섍꼍?먯꽌??吏㏐퀬 媛뺥븳 寃쎄퀬?뚯씠 鍮좊Ⅴ寃?吏?섍컩?덈떎. ?몄? 吏?곗? 諛붾줈 ?덉쟾 臾몄젣濡??댁뼱吏????덉뒿?덈떎.
二쇳뻾 ?곹솴?먯꽌??蹂듭옟???ㅻ챸蹂대떎 紐낇솗????蹂?? ??移댁슫?? 吏㏃? 臾몄옣????鍮좊Ⅸ ?먮떒???뺤뒿?덈떎.
紐⑤뱺 ?뚮━媛 寃쎄퀬媛 ?섎㈃ ?쒖뒪?쒖? 湲덈갑 ?쇰줈?댁쭛?덈떎. 洹몃옒??遺꾨쪟 紐⑤뜽怨??꾧퀎媛??ㅺ퀎媛 ?듭떖?낅땲??
System Flow
釉뚮씪?곗??먯꽌 留덉씠??沅뚰븳??諛쏄퀬 MediaRecorder濡??ㅻ뵒?ㅻ? 泥?겕 ?⑥쐞濡?罹≪쿂?⑸땲??
audio/webm ?곗씠?곕? WebSocket?쇰줈 ?쒕쾭???꾩넚???ㅼ떆媛?泥섎━ 援ъ“瑜?留뚮벊?덈떎.
?쒕쾭?먯꽌 ffmpeg ?먮뒗 pydub濡?16kHz 紐⑤끂 waveform?쇰줈 蹂?섑빀?덈떎.
?꾪뿕 ?뚮━ ?꾨낫援곗쓣 遺꾨쪟?섍퀬 ?됯퇏 score 湲곗??쇰줈 ?꾧퀎媛믪쓣 ?섎뒗 ?대깽?몃? ?좊퀎?⑸땲??
媛먯? 寃곌낵瑜??ㅼ떆 WebSocket?쇰줈 蹂대궡 ?쒓컖 寃쎄퀬, 濡쒓렇, ?곹깭 ?⑤꼸??利됱떆 諛섏쁺?⑸땲??
Detected Classes
肄붾뱶?먯꽌 ?꾪뿕 ?꾨낫濡??ㅻ(???뚮━ `Vehicle`, `Car horn`, `Emergency vehicle`, `Ambulance`, `Siren`, `Bicycle bell`, `Brake squeal` ???ㅼ젣 二쇳뻾 ?곹솴怨??곌껐???뚮━瑜?以묒떖?쇰줈 遺꾨쪟?⑸땲??UI Screens
Implementation
釉뚮씪?곗?? Python ?쒕쾭瑜?WebSocket?쇰줈 ?곌껐?섍퀬, ?ㅻ뵒???붿퐫???댄썑 YAMNet?쇰줈 遺꾨쪟?섎뒗 援ъ꽦???듭떖?낅땲??
Frontend
釉뚮씪?곗??먯꽌 ?ㅻ뵒???섏쭛 `getUserMedia`, `MediaRecorder`, WebSocket ?곌껐, ?곹깭 硫붿떆吏? 寃쎄퀬 ?⑤꼸 ?쒖떆Backend
Python 湲곕컲 ?ㅼ떆媛?泥섎━ `server.py`, `yamnet_websocket_server.py`?먯꽌 Flask Sock ?먮뒗 websockets 援ъ“濡??ㅼ떆媛??섏떊AI Model
YAMNet ?꾪뿕 ?뚮━ 遺꾨쪟 TensorFlow Hub??YAMNet??遺덈윭? ?됯퇏 score 湲곕컲?쇰줈 ?꾪뿕 ?대깽?몃? ?좊퀎?섍퀬 ?꾧퀎媛?0.5瑜??곸슜Processing
16kHz waveform 蹂??/strong> ffmpeg ?먮뒗 pydub瑜??ъ슜??WebM ?ㅻ뵒?ㅻ? 紐⑤뜽 ?낅젰 ?뺤떇?쇰줈 蹂?섑븯怨?遺꾨쪟 ?뺥솗?꾨? 留욎톬?듬땲??Demo Video
湲고쉷 ?붾㈃???꾨땲???ㅼ젣 ?숈옉 怨쇱젙??諛붾줈 ?뺤씤?????덈룄濡? ?꾨줈?앺듃 ?ㅽ뻾 ?곸긽???섏씠吏 ?덉뿉???댁뼱??蹂????덇쾶 援ъ꽦?덉뒿?덈떎.
Project Demo
?뚯꽦 媛먯?遺??寃쎄퀬 ?쇰뱶諛깃퉴吏 SafeRide媛 ?대뼡 諛⑹떇?쇰줈 ?뚮━瑜?諛쏆븘?ㅼ씠怨? 遺꾨쪟?섍퀬, ?ъ슜???붾㈃??寃쎄퀬瑜??꾨떖?섎뒗吏 ?ㅼ젣 ?쒖뿰 湲곗??쇰줈 ?뺤씤?????덈뒗 湲곕줉 ?곸긽?낅땲??Expected Effect
?뚮━瑜?吏곸젒 ?l? 紐삵빐?? 寃쎄퀬瑜??붾㈃怨??곹깭 蹂?붾줈 鍮좊Ⅴ寃?諛쏆븘 ?꾪뿕 ????쒓컙??以꾩씪 ???덉뒿?덈떎.
泥?컖 以묒떖 ?뚮┝???쒓컖 以묒떖 ?명꽣?섏씠?ㅻ줈 蹂?섑빐 ?대룞 寃쏀뿕 ?먯껜瑜???怨듯룊?섍쾶 留뚮뱶??諛⑺뼢???쒖븞?⑸땲??
?ν썑 吏꾨룞, ?⑥뼱?щ툝, 吏??寃쎄퀬, 二쇳뻾 湲곕줉怨?寃고빀?섎㈃ ???ㅼ슜?곸씤 ?덉쟾 蹂댁“ ?쒕퉬?ㅻ줈 ?뺤옣?????덉뒿?덈떎.
SafeRide???뚮━瑜??ш쾶 ?ㅻ젮二쇰뒗 ?쒖뒪?쒖씠 ?꾨땲??
?볦튂湲??ъ슫 ?꾪뿕????鍮좊Ⅴ寃?蹂댁씠寃?留뚮뱶??寃쎄퀬 寃쏀뿕