å°éå®¶ã«ããããŒã¿ããŒã¹è»¢éæŠç¥ã§ãè€éãªã³ã³ãã³ãç§»è¡ãããã²ãŒãããŸããããŒã¿ç§»åã®èª²é¡ã«åãçµãã°ããŒãã«ããŒã åãã®ãå®è·µçãªæŽå¯ãæäŸããŸãã
ã³ã³ãã³ãç§»è¡ããã¹ã¿ãŒããïŒã°ããŒãã«ãªèŠèŽè åãã®äžå¯æ¬ ãªããŒã¿ããŒã¹è»¢éæŠç¥
仿¥ã®çžäºæ¥ç¶ãããããžã¿ã«ç°å¢ã«ãããŠãçµç¹ã¯é »ç¹ã«ã³ã³ãã³ãç§»è¡ãããžã§ã¯ãã宿œããŠããŸããæ°ããããŒã¿ããŒã¹ã·ã¹ãã ãžã®ç§»è¡ãã¯ã©ãŠãããŒã¹ã®ãœãªã¥ãŒã·ã§ã³ãžã®ã¢ããã°ã¬ãŒããç°ãªããœãŒã¹ããã®ããŒã¿ã®çµ±åããŸãã¯æ°ããã³ã³ãã³ã管çãã©ãããã©ãŒã ã®æ¡çšãªã©ãèšå€§ãªéã®ããŒã¿ãããããŒã¿ããŒã¹ããå¥ã®ããŒã¿ããŒã¹ã«è»¢éããããã»ã¹ã¯è€éãªåãçµã¿ã§ããã°ããŒãã«ãªèŠèŽè ã«ãšã£ãŠãå ç¢ã§é©å¿æ§ã®é«ãããŒã¿ããŒã¹è»¢éæŠç¥ãçè§£ããããšã¯ãããžãã¹ãªãã¬ãŒã·ã§ã³ãžã®æå°éã®äžæã§ãã¹ã ãŒãºã§å®å šãã€å¹ççãªç§»è¡ãä¿èšŒããããã«äžå¯æ¬ ã§ãã
ãã®å æ¬çãªã¬ã€ãã§ã¯ãã³ã³ãã³ãç§»è¡ã®éèŠãªåŽé¢ãç¹ã«ããŒã¿ããŒã¹è»¢éæŠç¥ã«çŠç¹ãåœãŠãŠæãäžããŸããå°ççãªå Žæãæè¡çãªã¹ã¿ãã¯ã«é¢ä¿ãªããæåã«äžå¯æ¬ ãªåºæ¬çãªååãäžè¬çãªæ¹æ³è«ãäžå¯æ¬ ãªèšç»äºé ãããã³ãã¹ããã©ã¯ãã£ã¹ãæ¢æ±ããŸãã
ã³ã³ãã³ãç§»è¡ãšãã®éèŠæ§ã®çè§£
ã³ã³ãã³ãç§»è¡ãšã¯ãããžã¿ã«ã³ã³ãã³ããããã·ã¹ãã ãå ŽæããŸãã¯åœ¢åŒããå¥ã®ãã®ã«ç§»åããããã»ã¹ãæããŸãããã®ã³ã³ãã³ãã«ã¯ãããã¹ããç»åãåç»ãã¡ã¿ããŒã¿ããŠãŒã¶ãŒããŒã¿ããããŠæ±ºå®çã«ãããŒã¿ããŒã¹å ã«ååšããåºç€ãšãªãæ§é åããŒã¿ãå«ãå¹ åºãããŒã¿ãå«ãŸããŸããã³ã³ãã³ãç§»è¡ã®éèŠæ§ã¯ã以äžã«èµ·å ããŸãïŒ
- æè¡ç鲿©ïŒ ããæ°ããããã髿§èœã§ãã¹ã±ãŒã©ãã«ã§ããŸãã¯è²»çšå¯Ÿå¹æã®é«ãããŒã¿ããŒã¹æè¡ãæ¡çšããã
- ã·ã¹ãã çµ±åïŒ è€æ°ã®ããŒã¿ããŒã¹ãŸãã¯ã·ã¹ãã ãçµ±åããŠãå¹çãåäžãããè€éãã軜æžããåäžã®ãã©ãããã©ãŒã ã«ãŸãšããã
- ã¯ã©ãŠãå°å ¥ïŒ ãªã³ãã¬ãã¹ããŒã¿ããŒã¹ããæè»æ§ãšã¹ã±ãŒã©ããªãã£ã匷åããããã«ãAWS RDSãAzure SQL DatabaseããŸãã¯Google Cloud SQLãªã©ã®ã¯ã©ãŠãããŒã¹ã®ãœãªã¥ãŒã·ã§ã³ã«ç§»è¡ããã
- ã¢ããªã±ãŒã·ã§ã³ã®ã¢ããã°ã¬ãŒãïŒ ç°ãªãããŒã¿ããŒã¹èŠä»¶ãæã€å¯èœæ§ã®ããæ°ããããŒãžã§ã³ã®ã¢ããªã±ãŒã·ã§ã³ããµããŒãããããã«ããŒã¿ãç§»åããã
- å䜵ãšè²·åïŒ è²·åããäŒæ¥ããã®ããŒã¿ãæ¢åã®ã€ã³ãã©ã¹ãã©ã¯ãã£ã«çµ±åããã
- ããŒã¿ã¢ãŒã«ã€ããšã¢ããã€ãŒãŒã·ã§ã³ïŒ ã¬ã¬ã·ãŒããŒã¿ãæ°ããã·ã¹ãã ã«ç§»åããŠãã¢ã¯ã»ã¹ãšåæã容æã«ããå€ãã·ã¹ãã ã廿¢ããã
é©åã«å®è¡ãããã³ã³ãã³ãç§»è¡ãããžã§ã¯ãã¯ãããŒã¿ãæ£ç¢ºã«è»¢éãããã ãã§ãªããæ°ããç°å¢ã§ãã¢ã¯ã»ã¹å¯èœã§ãå®å šã§ã䜿çšå¯èœã§ããããšãä¿èšŒããŸããéã«ã管çãäžååãªç§»è¡ã¯ãããŒã¿ã®æå€±ãç Žæãé·æéã®ããŠã³ã¿ã€ã ãå€é¡ã®ã³ã¹ãè¶ éãããã³ãŠãŒã¶ãŒãšã¯ã¹ããªãšã³ã¹ãšäºæ¥ç¶ç¶æ§ãžã®æªåœ±é¿ã«ã€ãªããå¯èœæ§ããããŸãã
ããŒã¿ããŒã¹è»¢éãéå§ããåã«èæ ®ãã¹ãéèŠãªäºé
ããŒã¿ããŒã¹è»¢éã®æè¡çãªå®è¡ã«å ¥ãåã«ã培åºçãªèšç»æ®µéãäžå¯æ¬ ã§ãããã®æ®µéã¯æåã®èå°ãèšå®ããæœåšçãªãªã¹ã¯ã軜æžããŸããã°ããŒãã«ããŒã ã«ãšã£ãŠãç°ãªãå°åãã¿ã€ã ãŸãŒã³ã§ãããã®èæ ®äºé ã調æŽããããšãéèŠã§ãã
1. ã¹ã³ãŒããšç®æšã®å®çŸ©
ã©ã®ããŒã¿ãç§»è¡ããå¿ èŠãããã®ããã©ã®ãœãŒã¹ã·ã¹ãã ããã©ã®ã¿ãŒã²ããã·ã¹ãã ã«ç§»è¡ããå¿ èŠãããã®ããæç¢ºã«èª¬æããŸããç§»è¡ãéæããããšããŠããå ·äœçãªããžãã¹ç®æšãå®çŸ©ããŸããããã©ãŒãã³ã¹ã®åäžãã³ã¹ãåæžãã»ãã¥ãªãã£ã®åŒ·åããŸãã¯ä¿ææ§ã®åäžãæ±ããŠããŸããïŒæç¢ºãªå®çŸ©ã¯ã¹ã³ãŒãã¯ãªãŒããé²ããçŠç¹ã確å®ãªãã®ã«ããŸãã
2. ããŒã¿è©äŸ¡ãšãããã¡ã€ãªã³ã°
ããŒã¿ã®æ§è³ªãããªã¥ãŒã ãããã³è€éããçè§£ããŸããããã«ã¯ä»¥äžãå«ãŸããŸãïŒ
- ããŒã¿éïŒ è»¢éããããŒã¿ã®ç·éãæšå®ããã
- ããŒã¿ã®è€éãïŒ ããŒãã«æ§é ããªã¬ãŒã·ã§ã³ã·ãããããŒã¿åãããã³å¶çŽãåæããã
- ããŒã¿åè³ªïŒ éè€ãäžæŽåãæ¬ èœå€ãããã³èª€ã£ããã©ãŒããããªã©ã®åé¡ãç¹å®ããŠå¯ŸåŠããããœãŒã¹ã®ããŒã¿åè³ªãæªããšãäºåã«ã¯ãªãŒã³ã¢ããããªãå Žåãã¿ãŒã²ããã«äŒæããŸãã
- ããŒã¿ã®æ©å¯æ§ïŒ 転éäžã«é©åãªã»ãã¥ãªãã£å¯Ÿçãå®è£ ããããã«ãããŒã¿ã®æ©å¯æ§ïŒäŸïŒPIIã財åããŒã¿ãç¥ç財ç£ïŒã«åºã¥ããŠããŒã¿ãåé¡ããã
3. ã¿ãŒã²ããã·ã¹ãã ã®éžæãšæºå
ç®çã«æé©ãªã¿ãŒã²ããããŒã¿ããŒã¹ã·ã¹ãã ãéžæããŸããã¿ãŒã²ããã·ã¹ãã ããç§»è¡ãããããŒã¿ãåä¿¡ããã³ç®¡çããããã«é©åã«æ§æãããã¹ã±ãŒãªã³ã°ããããã¹ããããŠããããšã確èªããŸããããã«ã¯ãå¿ èŠãªã¹ããŒãããŠãŒã¶ãŒãããã³ã¢ã¯ã»ã¹å¶åŸ¡ã®èšå®ãå«ãŸããŸãã
4. ç§»è¡æŠç¥ã𿹿³è«ã®éžæ
ç§»è¡æŠç¥ã®éžæã¯ãããŠã³ã¿ã€ã 蚱容床ãããŒã¿éãããã³è€éããªã©ã®èŠå ã«å€§ããäŸåããŸãããããã«ã€ããŠã¯ã次ã®ã»ã¯ã·ã§ã³ã§è©³ãã説æããŸãã
5. ãªãœãŒã¹ã®å²ãåœãŠãšããŒã æ§é
å¿ èŠãªäººçè³æºãããŒã«ãããã³äºç®ãç¹å®ããŸããã°ããŒãã«ãããžã§ã¯ãã®å Žåãããã«ã¯ãç°ãªãå°ççãªå Žæã®ããŒã ã調æŽããæç¢ºãªã³ãã¥ãã±ãŒã·ã§ã³ãã£ãã«ã確ä¿ããé©åãªã³ã©ãã¬ãŒã·ã§ã³ããŒã«ã掻çšããããšãå«ãŸããŸãã圹å²ãšè²¬ä»»ãæç¢ºã«å®çŸ©ããŸãã
6. ãªã¹ã¯è©äŸ¡ãšè»œæžèšç»
ããŒã¿ã®ç Žæãã»ãã¥ãªãã£äŸµå®³ãããã©ãŒãã³ã¹ã®äœäžãããã³é·æéã®ããŠã³ã¿ã€ã ãªã©ã®æœåšçãªãªã¹ã¯ãç¹å®ããŸããç¹å®ãããåãªã¹ã¯ã«å¯Ÿããã³ã³ãã£ã³ãžã§ã³ã·ãŒèšç»ãšè»œæžæŠç¥ãéçºããŸãã
7. ããŠã³ã¿ã€ã 蚱容床ãšããžãã¹ãžã®åœ±é¿åæ
çµç¹ã®ããŠã³ã¿ã€ã ã«å¯Ÿãã蚱容床ãçè§£ããŸããããã¯ãç§»è¡ã¢ãããŒãã«å€§ããªåœ±é¿ãäžããŸããéèŠãªeã³ããŒã¹ãã©ãããã©ãŒã ã§ã¯ãã»ãŒãŒãã®ããŠã³ã¿ã€ã ãå¿ èŠã«ãªãå¯èœæ§ããããŸããã瀟å ã¬ããŒãããŒã¿ããŒã¹ã§ã¯ãããé·ãã¡ã³ããã³ã¹ãŠã£ã³ããŠã«èããããšãã§ããŸãã
ããŒã¿ããŒã¹è»¢éæ¹æ³è«ïŒé©åãªã¢ãããŒãã®éžæ
ããŒã¿ããŒã¹éã§ããŒã¿ã転éããããã®ããã€ãã®æ¹æ³è«ãååšããŸããæé©ãªéžæè¢ã¯ãå€ãã®å Žåãç¹å®ã®ãããžã§ã¯ãèŠä»¶ã«åãããŠèª¿æŽããããããã®çµã¿åãããå«ã¿ãŸãã
1. ãªãã©ã€ã³ç§»è¡ïŒããã°ãã³ã¢ãããŒãïŒ
説æïŒ ãã®ã¢ãããŒãã§ã¯ããœãŒã¹ã·ã¹ãã ãã·ã£ããããŠã³ããããã¹ãŠã®ããŒã¿ãæœåºã倿ãããã³ã¿ãŒã²ããã·ã¹ãã ã«ããŒãããããã®åŸãã¿ãŒã²ããã·ã¹ãã ããªã³ã©ã€ã³ã«ãªããŸããããã¯ããã¹ãŠã®ããŒã¿ãäžåºŠã«ç§»åãããããããããã°ãã³ãç§»è¡ãšåŒã°ããããšããããããŸãã
ã¡ãªããïŒ
- 段éçãªã¢ãããŒããããèšç»ãšå®è¡ãç°¡åã§ãã
- ç§»è¡ãŠã£ã³ããŠäžã«ãœãŒã¹ã§ããŒã¿ãçæãŸãã¯å€æŽãããŠããªããããããŒã¿ã®æŽåæ§ãä¿èšŒãããŸãã
- ããŠã³ã¿ã€ã ã蚱容ãããå Žåãå®éã®ããŒã¿è»¢éã«é¢ããŠã¯ãå€ãã®å Žåãããé«éã§ãã
ãã¡ãªããïŒ
- ããã·ã§ã³ã¯ãªãã£ã«ã«ãªã·ã¹ãã ã§ã¯åãå ¥ããããªãå¯èœæ§ã®ãããããªãã®ããŠã³ã¿ã€ã ãŠã£ã³ããŠãå¿ èŠã§ãã
- ãã¹ãŠããªãã©ã€ã³ã«ãªããããäœãåé¡ãçºçããå Žåã®ãªã¹ã¯ãé«ããªããŸãã
- èšç»ãããããŠã³ã¿ã€ã ãè¶ ããå¯èœæ§ã®ãã倧ããªããŒã¿éã
æé©ïŒ å°ããªããŒã¿ã»ãããå¯çšæ§ã®äœãèŠä»¶ã®ã·ã¹ãã ããŸãã¯å æ¬çãªããŠã³ã¿ã€ã ãŠã£ã³ããŠãã¹ã±ãžã¥ãŒã«ããŠèš±å®¹ã§ããå Žåã
2. ãªã³ã©ã€ã³ç§»è¡ïŒæ®µéçãŸãã¯ããªã¯ã«ã¢ãããŒãïŒ
説æïŒ ãã®æ¹æ³è«ã¯ã段éçãŸãã¯æ®µéçã«ç§»è¡ãå®è¡ããããšã«ãããããŠã³ã¿ã€ã ãæå°éã«æããããšãç®çãšããŠããŸããããŒã¿ã¯æåã«ãœãŒã¹ããã¿ãŒã²ããã«ã³ããŒããããœãŒã¹ã·ã¹ãã ã¯çšŒåãããŸãŸã§ããæ¬¡ã«ãç§»è¡ããã»ã¹äžã«ãœãŒã¹ã·ã¹ãã ã§çºçããå¯èœæ§ã®ãã倿ŽïŒæ¿å ¥ãæŽæ°ãåé€ïŒããã£ããã£ããŠè»¢éããããã®ã¡ã«ããºã ãå®è£ ãããŸããæåŸã«ãæ°ããã·ã¹ãã ãžã®éçšã®åãæ¿ãã«ã¯ãçãã«ãããªãŒããŒãŠã£ã³ããŠã䜿çšãããŸãã
ã¡ãªããïŒ
- ã¢ããªã±ãŒã·ã§ã³ã®ããŠã³ã¿ã€ã ãå€§å¹ ã«æå°éã«æããããæé€ããŸãã
- åäžã®å€§ããªè»¢éã«é¢é£ãããªã¹ã¯ã軜æžããŸãã
- æçµçãªã«ãããªãŒããŒã®åã«ãããŒã¿ã®ãµãã»ããã䜿çšããŠã¿ãŒã²ããã·ã¹ãã ã®åŸ¹åºçãªãã¹ããå¯èœã«ããŸãã
ãã¡ãªããïŒ
- 倿ŽããŒã¿ãã£ããã£ïŒCDCïŒãšåæãå¿ èŠãªãããèšç»ãšå®è¡ãããè€éã§ãã
- å°éã®ããŒã«ãšå°éç¥èãå¿ èŠã§ãã
- ç¶ç¶çãªåæããã»ã¹ãšãå Žåã«ãã£ãŠã¯ããé·ããããžã§ã¯ãæéã«ãããããé«ãã³ã¹ããçºçããå¯èœæ§ããããŸãã
- åæäžã®ãœãŒã¹ãšã¿ãŒã²ããéã®ããŒã¿ã®æŽåæ§ãç¶æããããšã¯å°é£ã«ãªãå¯èœæ§ããããŸãã
æé©ïŒ ããã·ã§ã³ã¯ãªãã£ã«ã«ãªã·ã¹ãã ãããŠã³ã¿ã€ã ããªãã·ã§ã³ã§ã¯ãªã倧ããªããŒã¿ã»ãããããã³æŽç·Žãããç§»è¡ããŒã«ãšããã»ã¹ã«æè³ã§ããçµç¹ã
3. ãã€ããªããã¢ãããŒã
å€ãã®å Žåããªãã©ã€ã³ãšãªã³ã©ã€ã³ã®æŠç¥ãçµã¿åãããŠäœ¿çšãããŸããããšãã°ã倧ããªå±¥æŽããŒã¿ã»ããã¯ãã¹ã±ãžã¥ãŒã«ãããã¡ã³ããã³ã¹ãŠã£ã³ããŠäžã«ãªãã©ã€ã³ã§ç§»è¡ãããå ŽåããããŸãããé²è¡äžã®ãã©ã³ã¶ã¯ã·ã§ã³ããŒã¿ã¯ãªã³ã©ã€ã³ã§åæãããŸãã
ããŒã¿ããŒã¹è»¢éæè¡ãšããŒã«
ããŸããŸãªæè¡ãšããŒã«ãããŒã¿è»¢éããã»ã¹ãä¿é²ããŸããããŒã«ã®éžæã¯ãå€ãã®å ŽåããœãŒã¹ããã³ã¿ãŒã²ããããŒã¿ããŒã¹ã·ã¹ãã ãããŒã¿ã®éãããã³å¿ èŠãªå€æã®è€éãã«äŸåããŸãã
1. æœåºã倿ãããŒãïŒETLïŒããŒã«
ETLããŒã«ã¯ããœãŒã¹ã·ã¹ãã ããããŒã¿ãæœåºããããžãã¹ã«ãŒã«ãšããŒã¿åè³ªæšæºã«åŸã£ãŠå€æããã¿ãŒã²ããã·ã¹ãã ã«ããŒãããããã«èšèšãããŠããŸãããããã¯ãè€éãªããŒã¿å€æãšçµ±åã«åŒ·åã§ãã
- äŸïŒ Informatica PowerCenterãTalendãMicrosoft SQL Server Integration ServicesïŒSSISïŒãApache NiFiãAWS GlueãAzure Data Factoryã
- ãŠãŒã¹ã±ãŒã¹ïŒ ãªã³ãã¬ãã¹ã®OracleããŒã¿ããŒã¹ããã¯ã©ãŠãããŒã¹ã®PostgreSQLããŒã¿ããŒã¹ãžã®ããŒã¿ã®ç§»è¡ãããŒã¿ã®ã¯ã¬ã³ãžã³ã°ãšåæ§ç¯ãå¿ èŠã
2. ããŒã¿ããŒã¹ãã€ãã£ãããŒã«
ã»ãšãã©ã®ããŒã¿ããŒã¹ã·ã¹ãã ã¯ãããŒã¿ã€ã³ããŒããšãšã¯ã¹ããŒããããã¯ã¢ãããšåŸ©å ããŸãã¯ã¬ããªã±ãŒã·ã§ã³çšã®ç¬èªã®çµã¿èŸŒã¿ããŒã«ãæäŸããŠãããããããç§»è¡ã«æŽ»çšã§ããŸãã
- SQL ServerïŒ BCPïŒãã«ã¯ã³ããŒããã°ã©ã ïŒãSQL Server Management StudioïŒSSMSïŒã€ã³ããŒã/ãšã¯ã¹ããŒããŠã£ã¶ãŒãããã©ã³ã¶ã¯ã·ã§ã³ã¬ããªã±ãŒã·ã§ã³ã
- PostgreSQLïŒ `pg_dump` ãš `pg_restore`ã`COPY` ã³ãã³ããè«çã¬ããªã±ãŒã·ã§ã³ã
- MySQLïŒ `mysqldump`ã`LOAD DATA INFILE`ãã¬ããªã±ãŒã·ã§ã³ã
- OracleïŒ Data PumpïŒexpdp / impdpïŒãSQL DeveloperãOracle GoldenGateïŒã¬ããªã±ãŒã·ã§ã³çšïŒã
ãŠãŒã¹ã±ãŒã¹ïŒ `mysqldump` ã䜿çšããŠãMySQLããŒã¿ããŒã¹ãå¥ã®MySQLã€ã³ã¹ã¿ã³ã¹ã«ç§»è¡ããç°¡åãªããŒã¿ãã³ããšåŸ©å ãè¡ããŸãã
3. ã¯ã©ãŠããããã€ããŒç§»è¡ãµãŒãã¹
äž»èŠãªã¯ã©ãŠããããã€ããŒã¯ãèªç€Ÿã®ãã©ãããã©ãŒã ãžã®ããŒã¿ããŒã¹ç§»è¡ãç°¡çŽ åããããã®å°çšãµãŒãã¹ãæäŸããŠããŸãã
- AWSïŒ Database Migration ServiceïŒDMSïŒãSchema Conversion ToolïŒSCTïŒã
- AzureïŒ Azure Database Migration ServiceãAzure Data Factoryã
- Google CloudïŒ Database Migration ServiceãCloud Data Fusionã
ãŠãŒã¹ã±ãŒã¹ïŒ AWS DMSã䜿çšããŠããªã³ãã¬ãã¹ã®SQL ServerããŒã¿ããŒã¹ãAmazon RDS for SQL Serverã«ç§»è¡ããŸããã¹ããŒã倿ãšç¶ç¶çãªããŒã¿ã¬ããªã±ãŒã·ã§ã³ãåŠçããŸãã
4. 倿ŽããŒã¿ãã£ããã£ïŒCDCïŒãã¯ãããžãŒ
CDCãã¯ãããžãŒã¯ããªã³ã©ã€ã³ç§»è¡ã«äžå¯æ¬ ã§ãããœãŒã¹ããŒã¿ããŒã¹ã§ã®ããŒã¿ã®å€æŽãã»ãŒãªã¢ã«ã¿ã€ã ã§è¿œè·¡ããŠãã£ããã£ããŸãã
- æ¹æ³ïŒ ãã°ããŒã¹ã®CDCïŒãã©ã³ã¶ã¯ã·ã§ã³ãã°ã®èªã¿åãïŒãããªã¬ãŒããŒã¹ã®CDCãã¿ã€ã ã¹ã¿ã³ãããŒã¹ã®CDCã
- ããŒã«ïŒ Oracle GoldenGateãQlik ReplicateïŒä»¥åã®AttunityïŒãStriimãDebeziumïŒãªãŒãã³ãœãŒã¹ïŒã
ãŠãŒã¹ã±ãŒã¹ïŒ ãã°ããŒã¹ã®CDCã䜿çšããŠãã¯ã©ãŠãå ã®ãªãŒãã¬ããªã«ããŒã¿ããŒã¹ããªã³ãã¬ãã¹ã®éçšããŒã¿ããŒã¹ãšåæãããŸãã
5. çŽæ¥ããŒã¿ããŒã¹æ¥ç¶ãšã¹ã¯ãªãã
ããç°¡åãªç§»è¡ã®å ŽåãçŽæ¥ããŒã¿ããŒã¹æ¥ç¶ãšã«ã¹ã¿ã ã¹ã¯ãªããïŒäŸïŒSQLAlchemyã䜿çšããPythonãPowerShellïŒã䜿çšããŠãããŒã¿ã®æœåºã倿ãããã³ããŒããè¡ãããšãã§ããŸããããã¯æå€§éã®æè»æ§ãæäŸããŸãããããªãã®éçºåŽåãå¿ èŠã§ãã
ãŠãŒã¹ã±ãŒã¹ïŒ ã«ã¹ã¿ã ããžãã¯ãå¿ èŠãªããŒã¿å€æãå¿ èŠãªå ŽåããŸãã¯æ¢è£œã®ããŒã«ã§ã¯å¹ççã«åŠçã§ããªãå¯èœæ§ãããå Žåãªã©ãå°ããªã¬ã¬ã·ãŒããŒã¿ããŒã¹ãææ°ã®SQLããŒã¿ããŒã¹ã«ç§»è¡ããŸãã
ç§»è¡ã©ã€ããµã€ã¯ã«ïŒã¹ããããã€ã¹ãããã¢ãããŒã
æ§é åãããç§»è¡ã©ã€ããµã€ã¯ã«ã¯ããã¹ãŠã®ãã§ãŒãºã广çã«ç®¡çãããããã«ããŸãããã®ã©ã€ããµã€ã¯ã«ã¯ãäžè¬çã«ãããŸããŸãªæ¹æ³è«ãããŒã«ã«é©çšã§ããŸãã
1. èšç»ãšèšèš
以åã«è©³ãã説æããããã«ããã®æåã®ãã§ãŒãºã«ã¯ãã¹ã³ãŒãã®å®çŸ©ãããŒã¿ã®è©äŸ¡ãæŠç¥ãšããŒã«ã®éžæãããã³ãªã¹ã¯è©äŸ¡ã®å®æœãå«ãŸããŸãã
2. ã¹ããŒãç§»è¡
ããã«ã¯ãã¿ãŒã²ããã·ã¹ãã ã«ããŒã¿ããŒã¹ã¹ããŒãïŒããŒãã«ããã¥ãŒãã€ã³ããã¯ã¹ãã¹ãã¢ãããã·ãŒãžã£ã颿°ïŒãäœæããããšãå«ãŸããŸãã AWS SCTãSSMAïŒSQL Server Migration AssistantïŒãªã©ã®ããŒã«ã¯ãããããŒã¿ããŒã¹ãã€ã¢ã¬ã¯ãããå¥ã®ããŒã¿ããŒã¹ãã€ã¢ã¬ã¯ããžã®ã¹ããŒãå®çŸ©ã®å€æãæ¯æŽã§ããŸãã
- äž»ãªã¿ã¹ã¯ïŒ
- ãœãŒã¹ãšã¿ãŒã²ããéã®ããŒã¿åã®ãããã³ã°ã
- ã¹ãã¢ãããã·ãŒãžã£ã颿°ãããªã¬ãŒã®å€æã
- å¿ èŠãªã€ã³ããã¯ã¹ãšå¶çŽã®äœæã
- ã¿ãŒã²ããç°å¢ã®ã¹ããŒãã®ç¢ºèªãšæé©åã
3. ããŒã¿ç§»è¡
ããã¯ãå®éã®ããŒã¿ãç§»åããäžå¿çãªããã»ã¹ã§ããéžæããæ¹æ³è«ïŒãªãã©ã€ã³ãŸãã¯ãªã³ã©ã€ã³ïŒã¯ãããã§äœ¿çšãããææ³ã決å®ããŸãã
- æé ïŒ
- æœåºïŒ ãœãŒã¹ããŒã¿ããŒã¹ããããŒã¿ãèªã¿åããŸãã
- å€æïŒ å¿ èŠãªå€æŽïŒã¯ã¬ã³ãžã³ã°ãåãã©ãŒãããããããã³ã°ïŒãé©çšããŸãã
- ããŒãïŒ ããŒã¿ãã¿ãŒã²ããããŒã¿ããŒã¹ã«æ¿å ¥ããŸãã
ããŒã¿æŽåæ§ãã§ãã¯ïŒ ãã®ãã§ãŒãºã§ã¯éèŠã§ããæ£ç¢ºæ§ã確ä¿ããããã«ãè¡æ°ããã§ãã¯ãµã ãããã³ãµã³ãã«ããŒã¿ã®æ€èšŒãå®è¡ããŸãã
4. ã¢ããªã±ãŒã·ã§ã³ã®ä¿®åŸ©ãšãã¹ã
ããŒã¿ãã¿ãŒã²ããã·ã¹ãã ã«é 眮ããããšãããŒã¿ããŒã¹ã«äŸåããã¢ããªã±ãŒã·ã§ã³ã¯ãæ°ããããŒã¿ããŒã¹ã«æ¥ç¶ããŠäœ¿çšããããã«æŽæ°ããå¿ èŠããããŸããããã«ã¯ä»¥äžãå«ãŸããŸãïŒ
- æ¥ç¶æååã®æŽæ°ïŒ ã¢ããªã±ãŒã·ã§ã³èšå®ã®å€æŽã
- SQLã¯ãšãªã®èª¿æŽïŒ ããŒã¿ããŒã¹åºæã§ããå¯èœæ§ã®ããã¯ãšãªãŸãã¯æ°ããç°å¢ã«åãããŠæé©åããå¿ èŠãããã¯ãšãªã®ä¿®æ£ã
- æ©èœãã¹ãïŒ ç§»è¡ãããããŒã¿ã§ããã¹ãŠã®ã¢ããªã±ãŒã·ã§ã³æ©èœãæåŸ ã©ããã«æ©èœããããšã確èªããŸãã
- ããã©ãŒãã³ã¹ãã¹ãïŒ ã¢ããªã±ãŒã·ã§ã³ãæ°ããããŒã¿ããŒã¹ã§é©åã«æ©èœããããšã確èªããŸãã
- ãŠãŒã¶ãŒåãå ¥ããã¹ãïŒUATïŒïŒ ãšã³ããŠãŒã¶ãŒãã·ã¹ãã ãæ€èšŒã§ããããã«ããŸãã
ã°ããŒãã«ããŒã ã®å ŽåãUATã¯ãã¹ãŠã®ãŠãŒã¶ãŒã°ã«ãŒãããã®ãã£ãŒãããã¯ãåéããããã«ãããŸããŸãªå°åã§èª¿æŽããå¿ èŠããããŸãã
5. ã«ãããªãŒããŒ
ããã¯ãå€ãã·ã¹ãã ããæ°ããã·ã¹ãã ãžã®æçµçãªåãæ¿ãã§ãããªã³ã©ã€ã³ç§»è¡ã®å Žåãããã«ã¯ããã¹ãŠã®ããŒã¿ãåæãããããã«çãããŠã³ã¿ã€ã ãŠã£ã³ããŠãå«ãŸãããã®åŸãã¢ããªã±ãŒã·ã§ã³ãã©ãã£ãã¯ãæ°ããããŒã¿ããŒã¹ã«ãªãã€ã¬ã¯ãããŸãã
- æé ïŒ
- ãœãŒã¹ã·ã¹ãã ãžã®æžã蟌ã¿ã忢ããŸãã
- æçµçãªããŒã¿åæãå®è¡ããŸãã
- ããŒã¿æŽåæ§ãããäžåºŠæ€èšŒããŸãã
- æ°ããããŒã¿ããŒã¹ãæãããã«ã¢ããªã±ãŒã·ã§ã³ãåæ§æããŸãã
- æ°ããã·ã¹ãã ãå®å šã«ãªã³ã©ã€ã³ã«ããŸãã
6. ç§»è¡åŸã®æ€èšŒãšç£èŠ
ã«ãããªãŒããŒåŸãæ°ããã·ã¹ãã ãã¹ã ãŒãºã«åäœããããã«ç¶ç¶çãªç£èŠãäžå¯æ¬ ã§ããããã«ã¯ä»¥äžãå«ãŸããŸãïŒ
- ããã©ãŒãã³ã¹ç£èŠïŒ ããŒã¿ããŒã¹ãšã¢ããªã±ãŒã·ã§ã³ã®ããã©ãŒãã³ã¹ã远跡ããŸãã
- ãšã©ãŒãã®ã³ã°ïŒ çºçããåé¡ãç¹å®ããŠè§£æ±ºããŸãã
- ããŒã¿æŽåæ§ãã§ãã¯ïŒ ããŒã¿æŽåæ§ã®å®æçãªæ€èšŒã
- å€ãã·ã¹ãã ã®å»æ¢ïŒ æ°ããã·ã¹ãã ã®ä¿¡é Œæ§ãé«ããªã£ãããå€ãããŒã¿ããŒã¹ãšã€ã³ãã©ã¹ãã©ã¯ãã£ãå®å šã«å»æ¢ã§ããŸãã
ã°ããŒãã«ã³ã³ãã³ãç§»è¡ã®éèŠãªæåèŠå
æåããããŒã¿ããŒã¹ç§»è¡ã確å®ã«ããã«ã¯ãããã€ãã®èŠå ãäžå¯æ¬ ã§ããç¹ã«ã忣åã®ã°ããŒãã«ããŒã ãšé£æºããå Žåã§ãã
1. å ç¢ãªã³ãã¥ãã±ãŒã·ã§ã³ãšã³ã©ãã¬ãŒã·ã§ã³
æç¢ºãªã³ãã¥ãã±ãŒã·ã§ã³ãã£ãã«ãšãããã³ã«ã確ç«ããŸããããŸããŸãªã¿ã€ã ãŸãŒã³ããµããŒãããéåæéä¿¡ãå¯èœã«ããã³ã©ãã¬ãŒã·ã§ã³ãã©ãããã©ãŒã ã䜿çšããŸãã宿çãªã¹ããŒã¿ã¹æŽæ°ãå ±æããã¥ã¡ã³ããªããžããªãããã³æç¢ºã«å®çŸ©ãããäŒè°ã®é »åºŠã¯éåžžã«éèŠã§ãã
2. å æ¬çãªãã¹ãæŠç¥
ãã¹ãã®éèŠæ§ãéå°è©äŸ¡ããªãã§ãã ããããã«ãã¹ããŒãžãã¹ãèšç»ãå®è£ ããŸããã¹ããŒããšã¹ã¯ãªããã®åäœãã¹ããã¢ããªã±ãŒã·ã§ã³ãšã®çµ±åãã¹ããè² è·äžã®ããã©ãŒãã³ã¹ãã¹ããããã³ãã¹ãŠã®é¢é£ãŠãŒã¶ãŒã°ã«ãŒããšå°åã§ã®UATã
3. ããã»ã¹å šäœã§ã®ããŒã¿ã»ãã¥ãªãã£
ããŒã¿ã»ãã¥ãªãã£ã¯ããã¹ãŠã®æ®µéã§æåªå äºé ã§ãªããã°ãªããŸãããããã«ã¯ä»¥äžãå«ãŸããŸãïŒ
- ããŒã¿æå·åïŒ è»¢éäžã®ããŒã¿ïŒäŸïŒTLS / SSLã®äœ¿çšïŒãšããœãŒã¹ãšã¿ãŒã²ããã®äž¡æ¹ã®ã·ã¹ãã å ã®ä¿åäžã®ããŒã¿ã®æå·åã
- ã¢ã¯ã»ã¹å¶åŸ¡ïŒ ç§»è¡ããŒã«ãšäººå¡ã«å¯Ÿãã峿 Œãªã¢ã¯ã»ã¹å¶åŸ¡ã®å®è£ ã
- ã³ã³ãã©ã€ã¢ã³ã¹ïŒ ç°ãªã管èœåºåã§ãé¢é£ããããŒã¿ãã©ã€ãã·ãŒèŠå¶ïŒäŸïŒGDPRãCCPAïŒãéµå®ããã
4. ãã§ãŒãºå¥ã®ããŒã«ã¢ãŠããšããŒã«ããã¯èšç»
è€éãªç§»è¡ã®å Žåããã§ãŒãºå¥ã®ããŒã«ã¢ãŠãã¯ãªã¹ã¯ã軜æžã§ããŸããåžžã«ãé©åã«ææžåãããããŒã«ããã¯èšç»ãæºåããŠãã ããããã®èšç»ã§ã¯ãã«ãããªãŒããŒäžãŸãã¯ã«ãããªãŒããŒçŽåŸã«é倧ãªåé¡ãçºçããå Žåã«ãå ã®ã·ã¹ãã ã«æ»ãããã«å¿ èŠãªæé ã«ã€ããŠè©³ãã説æããå¿ èŠããããŸãã
5. ã¹ãã«ãšçµéšè±å¯ãªããŒã
ç§»è¡ããŒã ãããŒã¿ããŒã¹ç®¡çãããŒã¿ãšã³ãžãã¢ãªã³ã°ãã¢ããªã±ãŒã·ã§ã³éçºãããã³ãããžã§ã¯ã管çã«å¿ èŠãªå°éç¥èãæã£ãŠããããšã確èªããŠãã ãããã°ããŒãã«ãããžã§ã¯ãã®å Žåãç°æåéã®ã³ãã¥ãã±ãŒã·ã§ã³ãšåæ£åãããžã§ã¯ã管çã®çµéšãæã€ããŒã ã¡ã³ããŒãããããšã¯éåžžã«éèŠã§ãã
6. èªååã®æŽ»çš
ã¹ããŒãã®å±éãããŒã¿ã®æœåºãšããŒããããã³æ€èšŒãã§ãã¯ãªã©ãå¯èœãªéãå€ãã®ç§»è¡ã¿ã¹ã¯ãèªååããŸããèªååã«ãããæåã®ãšã©ãŒãæžããããã»ã¹ãé«éåãããäžè²«æ§ã確ä¿ãããŸãã
7. ãã³ããŒãµããŒããšå°éç¥è
ãµãŒãããŒãã£ã®ããŒã«ãŸãã¯ã¯ã©ãŠããµãŒãã¹ã䜿çšããå Žåã¯ããã³ããŒããé©åãªãµããŒããåããŠããããšã確èªããŠãã ããã圌ãã®å°éç¥èã¯ãè€éãªåé¡ã®ãã©ãã«ã·ã¥ãŒãã£ã³ã°ãšç§»è¡ããã»ã¹ã®æé©åã«äžå¯æ¬ ã§ãã
ããŒã¿ããŒã¹ç§»è¡ã«ãããäžè¬çãªèª²é¡ãšããããå æããæ¹æ³
ããŒã¿ããŒã¹ç§»è¡ã«ã¯ãå°é£ã䌎ããŸãããããã®äžè¬çãªèª²é¡ãèªèããããšã§ããããã«ç©æ¥µçã«å¯ŸåŠã§ããŸãã
1. ããŒã¿ã®äžæŽåãšç Žæ
課é¡ïŒ ã¹ã¯ãªããã®ãšã©ãŒãäºææ§ã®ãªãããŒã¿åããŸãã¯ãããã¯ãŒã¯ã®åé¡ã«ãããããŒã¿ãæœåºã倿ããŸãã¯ããŒãäžã«äžæŽåãŸãã¯ç Žæããå¯èœæ§ããããŸãã
解決çïŒ åæ®µéã§å³æ ŒãªããŒã¿æ€èšŒãã§ãã¯ãå®è£ ããŸãããã§ãã¯ãµã ãããã·ã¥æ¯èŒãããã³è¡æ°ã䜿çšããŸããçµã¿èŸŒã¿ã®ãšã©ãŒåŠçãšãã®ã³ã°ãåããæçããETLããŒã«ã掻çšããŸãããªã³ã©ã€ã³ç§»è¡ã®å Žåã¯ãå ç¢ãªCDCã¡ã«ããºã ã確ä¿ããŸãã
2. é·æéãŸãã¯èšç»å€ã®ããŠã³ã¿ã€ã
課é¡ïŒ ç§»è¡ããã»ã¹ã«äºæ³ä»¥äžã®æéãããããããžãã¹ãªãã¬ãŒã·ã§ã³ã«åœ±é¿ãäžããé·æéã®ããŠã³ã¿ã€ã ãçºçããå¯èœæ§ããããŸãã
解決çïŒ ç§»è¡ããã»ã¹ãæ¬çªåç°å¢ã§åŸ¹åºçã«ãã¹ãããŠãå¿ èŠãªæéãæ£ç¢ºã«èŠç©ãããŸããããŠã³ã¿ã€ã ãéèŠãªå Žåã¯ããªã³ã©ã€ã³ç§»è¡æŠç¥ãéžæããŸãã詳现ãªã³ã³ãã£ã³ãžã§ã³ã·ãŒãšããŒã«ããã¯èšç»ãäœæããŸãã
3. ç§»è¡åŸã®ããã©ãŒãã³ã¹ã®äœäž
課é¡ïŒ æé©åãããŠããªãã¹ããŒããäžè¶³ããŠããã€ã³ããã¯ã¹ããŸãã¯éå¹ççãªã¯ãšãªãåå ã§ãã¿ãŒã²ããããŒã¿ããŒã¹ãŸãã¯ã¢ããªã±ãŒã·ã§ã³ãç§»è¡åŸã«ããŸãæ©èœããªãå¯èœæ§ããããŸãã
解決çïŒ ã«ãããªãŒããŒåã«å æ¬çãªããã©ãŒãã³ã¹ãã¹ãã宿œããŸããããŒã¿ããŒã¹ã¹ããŒããæé©åããé©åãªã€ã³ããã¯ã¹ãäœæããã¿ãŒã²ããããŒã¿ããŒã¹ã«åãããŠã¢ããªã±ãŒã·ã§ã³ã¯ãšãªã調æŽããŸããç§»è¡åŸã®ããã©ãŒãã³ã¹ãç¶¿å¯ã«ç£èŠããå¿ èŠã«å¿ããŠèª¿æŽããŸãã
4. ã»ãã¥ãªãã£ã®è匱æ§
課é¡ïŒ 転éäžããŸãã¯ã¢ã¯ã»ã¹å¶åŸ¡ãé©åã«ç®¡çãããŠããªãå Žåãæ©å¯ããŒã¿ãå ¬éãããå¯èœæ§ããããŸãã
解決çïŒ è»¢éäžããã³ä¿åäžã®ãã¹ãŠã®ããŒã¿ãæå·åããŸããç§»è¡ããŒã«ãšäººå¡ã«å¯Ÿãã峿 Œãªã¢ã¯ã»ã¹å¶åŸ¡ãšèªèšŒãå®è£ ããŸãããã¹ãŠã®éçšå°åã§ãé¢é£ããããŒã¿ãã©ã€ãã·ãŒèŠå¶ãéµå®ããŠããããšã確èªããŸãã
5. ãœãŒã¹ã·ã¹ãã ãšã¿ãŒã²ããã·ã¹ãã éã®éäºææ§
課é¡ïŒ ãœãŒã¹ããŒã¿ããŒã¹ãšã¿ãŒã²ããããŒã¿ããŒã¹éã®SQLãã€ã¢ã¬ã¯ããããŒã¿åãæåã»ããããŸãã¯æ©èœã®éãã«ãããç§»è¡ãè€éã«ãªãå¯èœæ§ããããŸãã
解決çïŒ ã¹ããŒã倿ããŒã«ïŒäŸïŒAWS SCTãSSMAïŒã䜿çšããŠãéäºææ§ãç¹å®ããŠå¯ŸåŠããŸããã¹ããŒããšããŒã¿åã®ãããã³ã°ã培åºçã«ãã¹ãããŸããè€éãªå€æã®ããã«ã«ã¹ã¿ã ã³ãŒããèšè¿°ããæºåãããŸãã
6. ã¹ã³ãŒãã¯ãªãŒã
課é¡ïŒ äºæããªãèŠä»¶ãã远å ã®ããŒã¿ãŸãã¯æ©èœãç§»è¡ããããã®èŠæ±ã«ããããããžã§ã¯ãã®ã¹ã³ãŒããåœåã®èšç»ãè¶ ããŠæ¡å€§ããå¯èœæ§ããããŸãã
解決çïŒ å³æ Œãªå€æŽç®¡çããã»ã¹ãç¶æããŸããæåã«ãããžã§ã¯ãã¹ã³ãŒããæç¢ºã«å®çŸ©ãããã¹ãŠã®é¢ä¿è ããããçè§£ããåæããããã«ããŸãã倿Žã¯ãã¹ãŠãã¿ã€ã ã©ã€ã³ãäºç®ãããã³ãªãœãŒã¹ãžã®åœ±é¿ã«ã€ããŠæ£åŒã«è©äŸ¡ããå¿ èŠããããŸãã
ã°ããŒãã«ããŒã¿ããŒã¹ç§»è¡ã®ãã¹ããã©ã¯ãã£ã¹
ã°ããŒãã«ã³ã³ãã³ãç§»è¡ã®è€éããä¹ãåãã«ã¯ããã¹ããã©ã¯ãã£ã¹ãéµå®ããããšãéèŠã§ãã
- å°ããå§ããŠãå埩ããïŒ å¯èœã§ããã°ãäž»èŠãªç§»è¡ã«çæããåã«ãå°ããªããŒã¿ã»ãããŸãã¯ããã»ã©éèŠã§ãªãã·ã¹ãã ã䜿çšããŠãã€ãããç§»è¡ãå®è¡ããããã»ã¹ãšããŒã«ãæŽç·ŽãããŸãã
- ãã¹ãŠãææžåããïŒ ç§»è¡èšç»ãã¹ã¯ãªãããæ§æããã¹ãçµæãããã³æèšãªã©ããã¹ãŠã®æé ã«ã€ããŠè©³çްãªããã¥ã¡ã³ããä¿æããŸãã
- ãã¹ãŠãããŒãžã§ã³ç®¡çããïŒ ã¹ã¯ãªãããæ§æãããã³ããã¥ã¡ã³ãã«ã¯ãããŒãžã§ã³ç®¡çã·ã¹ãã ïŒäŸïŒGitïŒã䜿çšããŸãã
- ããŒã¿å質ãåªå ããïŒ åé¡ãçºçãããªãããã«ãç§»è¡åã«ããŒã¿ã®ã¯ãªãŒã³ã¢ãããšæ€èšŒã«æéãè²»ãããŸãã
- é¢ä¿è ãæ©æãã€é »ç¹ã«åå ãããïŒ ç§»è¡ããã»ã¹å šäœãéããŠããã¹ãŠã®é¢é£ããé¢ä¿è ã«æ å ±ãæäŸããåå ãããŸãã
- ãã¹ãããã¹ãããããŠããäžåºŠãã¹ãããïŒ ãã¹ãã劥åããªãã§ãã ããããã¹ãŠã®ç°å¢ã§ã®åŸ¹åºçãªãã¹ãã¯ãæ¬çªç°å¢ã«åœ±é¿ãåã¶åã«åé¡ãæ€åºããããã®æè¯ã®æ¹æ³ã§ãã
- ç§»è¡åŸã®æé©åãèšç»ããïŒ ç§»è¡ã¯æçµçãªç®æšã§ã¯ãããŸãããæ°ããã·ã¹ãã ãæé©ã«æ©èœããããšã確èªããããšãéèŠã§ããç§»è¡åŸã®èª¿æŽã«ãªãœãŒã¹ãå²ãåœãŠãŸãã
çµè«
ã³ã³ãã³ãç§»è¡ãç¹ã«ããŒã¿ããŒã¹è»¢éã¯ãææ°ã®ITéçšã®éèŠã§ãããªããå°é£ãªåŽé¢ã§ããã°ããŒãã«ãªçµç¹ã®å Žåãå°ççãªåæ£ãšå€æ§ãªéçšã³ã³ããã¹ãã«ãã£ãŠè€éããå¢å¹ ãããŸããæŠç¥çãªã¢ãããŒããæ¡çšããåãã§ãŒãºãç¶¿å¯ã«èšç»ããé©åãªæ¹æ³è«ãšããŒã«ãéžæãããã¹ããã©ã¯ãã£ã¹ãéµå®ããããšã«ãããäŒæ¥ã¯ãããã®è€éããããŸãä¹ãåãããšãã§ããŸãã
é©åã«å®è¡ãããããŒã¿ããŒã¹è»¢éã¯ãããŒã¿ã®æŽåæ§ãã»ãã¥ãªãã£ãããã³ã¢ã¯ã»ã¹å¯èœæ§ãä¿èšŒããã·ã¹ãã ã®ããã©ãŒãã³ã¹ãã¹ã±ãŒã©ããªãã£ãããã³ããžã¿ã«ãã©ã³ã¹ãã©ãŒã¡ãŒã·ã§ã³ã®ç®æšã®å®çŸãä¿é²ããŸããæç¢ºãªã³ãã¥ãã±ãŒã·ã§ã³ãå æ¬çãªãã¹ããããã³å ç¢ãªãªã¹ã¯ç®¡çãåªå ããããšã¯ãã°ããŒãã«ç§»è¡ãæåãããããã®åºç€ãšãªããŸãã