117 lines
18 KiB
Plaintext
117 lines
18 KiB
Plaintext
|
ó
|
|||
|
|
¹1?jàE ã óP • S SK r S SKrS SKrS SKrS SKrS SKrS SKrS SKrS SKrS SK J
|
|||
|
|
r
|
|||
|
|
S SK J r J
|
|||
|
|
r
|
|||
|
|
Jr S rS rS#S jrS rS$S jr\S :X Ga- \R* " S
|
|||
|
|
S9r\R/ S\SSS9 \R/ S\SSS9 \R/ SSSS9 \R/ S\SSS9 \R/ S \S S S9 \R/ S \S
|
|||
|
|
S S9 \R5 5 r\R8 ( aP \R8 R; S 5 V s/ s H) o R= 5 ( d M U R= 5 PM+ sn OSr \" \R@ \ \RB \RD \RF \RH S!9 ggs sn f ! \% a \&" S"5 \RN " S 5 gf = f)%é N)Ú
|
|||
|
|
BeautifulSoup)ÚquoteÚunquoteÚurlparsec ó¢ • U ( d g[ U S5 nUR S5 H nUR S5 M UR S5 H nUR S5 M UR S5 H% nUR S5 UR S5 M' UR S S
|
|||
|
|
/5 H1 nUR 5 nU( d M UR S U S 35 M3 UR S 5 HO nUR 5 nUR
|
|||
|
|
S
|
|||
|
|
S5 nU( d M. U( d M7 UR SU SU S35 MQ UR 5 nUR S5 V s/ s H o™R 5 PM n
|
|||
|
|
n SR U
|
|||
|
|
5 n SU ; a U R SS5 n SU ; a M U R 5 $ s sn f )NÚ ú html.parserÚpz
|
|||
|
|
|
|||
|
|
ÚbrÚ
|
|||
|
|
Úliz- ÚstrongÚbú**ÚaÚhrefÚ[z](Ú)z
|
|||
|
|
|
|||
|
|
|
|||
|
|
) r Úfind_allÚ insert_afterÚ replace_withÚ
|
|||
|
|
insert_beforeÚget_textÚgetÚsplitÚrstripÚjoinÚreplaceÚstrip) Ú html_contentÚsoupr
|
|||
|
|
r r
|
|||
|
|
r Útextr r ÚlineÚlinesÚ cleaned_texts Ú!/root/go/ws/QUZ/scrape_cbtbank.pyÚhtml_to_markdownr'
|
|||
|
|
s‘ € Þ ØÜ ˜ }Ó 5€Dð �]‰]˜3Ö
|
|||
|
|
ˆØ �‰�vÖ ñ ð �m‰m˜DÖ!ˆØ
|
|||
|
|
�‰˜Ö ñ "ð �m‰m˜DÖ!ˆØ
|
|||
|
|
×Ñ˜Ô Ø
|
|||
|
|
�‰˜Ö ñ "ð
|
|||
|
|
—-‘- ¨3 Ö0ˆØ�‰Ó ˆß ˆ4Ø × Ñ " T F¨"
|
|||
|
|
Ö .ñ 1ð �]‰]˜3Ö
|
|||
|
|
ˆØ�z‰z‹|ˆØ�u‰u�V˜RÓ ˆß ˆ4—D�DØ
|
|||
|
|
�N‰N˜Q˜t˜f B t f¨AÐ.Ö /ñ ð �=‰=‹?€Dð (,§z¡z°$Ô'7Ó 8Ò'7˜t�[‰[Ž]Ñ'7€EÐ 8Ø—9‘9˜UÓ#€LØ
|
|||
|
|
�lÓ
|
|||
|
|
"Ø#×+Ñ+¨H°fÓ=ˆ ð �lÕ
|
|||
|
|
"à × Ñ Ó Ð ùò
|
|||
|
|
9s Å0G c ó • [ R R [ U 5 R 5 S nU( a [ U5 S:” a Sn[
|
|||
|
|
R " U R S5 5 R 5 nSU U 3$ )Né é z.pngúutf-8Úcbtbank_) ÚosÚpathÚsplitextr ÚlenÚhashlibÚmd5ÚencodeÚ hexdigest)ÚurlÚextÚhs r& Úget_image_filenamer8 5 sh € Ü
|
|||
|
|
�'‰'×
|
|||
|
|
Ñ
|
|||
|
|
œ8 C›=×-Ñ-Ó
|
|||
|
|
.¨qÑ
|
|||
|
|
1€CÞ ”#�c“(˜Q“,؈Ü� Š �C—J‘J˜wÓ'Ó(×2Ñ2Ó4€AØ
|
|||
|
|
�a�S˜˜Ð Ð ó ç ð?c óú • U ( d g U R S5 ( a SU 3n U R S5 ( d U $ [ R " USS9 [ U 5 n[ R R X5 n[ R R
|
|||
|
|
U5 ( a SU 3$ [ R " U5 SS0n[ R " XS S
|
|||
|
|
9nUR S :X aC [ US 5 nUR UR 5 S S S 5 [ S
|
|||
|
|
U 35 SU 3$ [ SU SUR S35 U $ ! , ( d f N@= f! [ a n[ SU 35 S nAU $ S nAff = f)NÚ/zhttps://cbtbank.krÚhttpT)Úexist_okz/assets/ú
|
|||
|
|
User-AgentúsMozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36é ©ÚheadersÚtimeoutéÈ Úwbz [Image] Downloaded image: z* [Image Warning] Failed to download: z (HTTP r z- [Image Error] Error downloading image: )Ú
|
|||
|
|
startswithr- Úmakedirsr8 r. r ÚexistsÚtimeÚsleepÚrequestsr Ú status_codeÚopenÚwriteÚcontentÚprintÚ Exception) Ú image_urlÚ
|
|||
|
|
target_dirÚdelayÚfilenameÚ dest_pathrC ÚrÚfÚes r& Údownload_and_save_imager[ < sd € Þ Øð ×јC× Ñ Ø(¨¨ Ð4ˆ à × Ñ × 'Ñ 'ØÐðCÜ
|
|||
|
|
� Š �J¨Ò.Ü% iÓ0ˆÜ—G‘G—L‘L Ó6ˆ ä
|
|||
|
|
�7‰7�>‰>˜)× $Ñ $Ø ˜h˜ZÐ(Ð (ä �
|
|||
|
|
Š
|
|||
|
|
�5Ôà ð Pð
|
|||
|
|
ˆô
|
|||
|
|
�LŠL˜¸RÑ @ˆØ �=‰=˜CÓ Ü�i Ô&¨!Ø—‘˜Ÿ ™ Ô"÷ 'ä Ð4°X°JÐ?Ô @Ø ˜h˜ZÐ(Ð (ä Ð>¸y¸kÈÐQR×Q^ÑQ^ÐP_Ð_`ÐaÕ bð Ð÷ 'Õ&ûô ó CÜ
|
|||
|
|
Ð=¸a¸SÐA×BÐBØ ÐûðCús= ½A'E Â%A E Ã0 EÄ E Ä' E Å
|
|||
|
|
EÅE Å
|
|||
|
|
E:Å!E5Å5E:c ó” • U R 5 nUR S5 UR 5 Vs1 s H o"S iM sn$ s snf )Nz5SELECT id FROM QuizQuestions WHERE source = 'cbtbank'r )ÚcursorÚexecuteÚfetchall)Úconnr] Úrows r& Úget_existing_question_idsrb _ s= € Ø
|
|||
|
|
�[‰[‹]€FØ
|
|||
|
|
‡N�NÐJÔKØ $Ÿo™oÔ /Ó 0Ò /�s�ŒFÑ /Ñ 0Ð0ùÒ 0s ´Aú qple_quiz.dbú./frontend/public/assetsc ó< ^L• [ R " U5 nUR 5 nUR S5 UR 5 Vs/ s H oˆS PM n nSU ; a, UR S5 UR 5 [
|
|||
|
|
S5 [ U5 n
|
|||
|
|
[
|
|||
|
|
SU 35 [
|
|||
|
|
SU 35 S[ U 5 3n S S
|
|||
|
|
0n [
|
|||
|
|
S U 35 [ R " X¼S S
|
|||
|
|
9n
|
|||
|
|
SU
|
|||
|
|
l U
|
|||
|
|
R S:w a) [
|
|||
|
|
SU
|
|||
|
|
R 35 UR 5 g [ U
|
|||
|
|
R S5 n/ nUR! S5 Ht nUR SS5 nUR# S5 ( d M- UR% S5 S nUR' 5 R) 5 nUR+ UUUS.5 Mv [- 5 n/ nU H3 nUS U; d M UR/ US 5 UR+ U5 M5 [
|
|||
|
|
S[1 U5 S35 U H n[
|
|||
|
|
S US S US S 35 M U( aV U Vs/ s H nUS U; d US U; d M UPM nn[
|
|||
|
|
S [1 U5 S!U Vs/ s H nUS PM
|
|||
|
|
sn 35 Un[3 US5 GHï u nnUS nUS nS"U 3n[
|
|||
|
|
S#5 [
|
|||
|
|
S$U S[1 U5 S%U 35 [
|
|||
|
|
S&U 35 [
|
|||
|
|
S'5 [4 R6 " U5 [ R " UU S S
|
|||
|
|
9n
|
|||
|
|
SU
|
|||
|
|
l U
|
|||
|
|
R S:w a [
|
|||
|
|
S(U
|
|||
|
|
R 35 M´ [ U
|
|||
|
|
R S5 nUR9 S)S*9nU( d
|
|||
|
|
[
|
|||
|
|
S+5 Mí S,n S-n UR: GHÛ n U R< ( d M U R S./ 5 n S/R? U 5 n S0U ; ah U R' 5 R) 5 n!S1U!; a$ U!R% S1S5 S R) 5 n OU!R) 5 n [
|
|||
|
|
S2U 35 M¨ S3U ; d M° U R! S4S*9n"U" GH n#U#R S55 n$U$( d M S-S K n%U%RC U$RE S5 5 S6- n&[
|
|||
|
|
S7U$ S8U& S9U S 35 U&U
|
|||
|
|
; a U( d [
|
|||
|
|
S:U$ S8U& S;35 M{ U#R9 S<S*9n'U'( d
|
|||
|
|
[
|
|||
|
|
S=5 Mž S n(U#R! S>5 n)U) He n*U*RG S?S*9( d U*RG S@S*9( a M- U*R SA5 mLTL( d MG [I UL4SB jSC 5 5 ( a Mc TLn( O S-S K%n+U+RK U'5 n,U,R9 SDS*9n-U-( a U-RM 5 U,R! S>5 H n*U*RM 5 M U,R' 5 R) 5 n.[N RP " SESU.5 R) 5 n.Sn/U#R9 SFS*9n0U0( a [S [U U05 5 n// SGQn1Sn2Sn3Sn4U#R9 S@S*9n5U5( Ga U5R9 SH5 n6U6( a U6R SI5 OS n7U5R! SJ5 n8[3 U85 H‘ u n9n:U:R9 S>5 n;U;( a. U;R SA5 mLTL( a [W TLXS5 n<SKU< SL3n=O!Sn=O U:R' 5 R) 5 n=U9SM: a U=U1U9' SIU:R S./ 5 ; d M� U9n2U=n3M“ U2S:X a4 U7( a- [Y U75 S-
|
|||
|
|
n2S-U2s=:: a [1 U15 : a O OU1U2 n3U5( a [I U15 ( d / SGQn1Sn2SNn3U2S:w a [U U25 OSn4Sn>U(( a [W U(XS5 n>/ n?/ n@U#R9 SOS*9nAUA( aÄ WAR! SPS*9nBUB H¯ nCUCR9 SQS*9nDUD( a WDR' 5 R) 5 OSnEWCR9 SRS*9nFUF( d MQ [S [U WF5 5 nGSSWE; d STWER] 5 ; a W@R+ SUWE SVWG 35 M˜ U?R+ SWWE SXWG 35 M± SYR? U?5 nHSYR? W@5 nI[^ R` " SZU$UU S[.S\S]9nJUR 5 n UR S^U&S_U U.U1S- U1S U1S` U1Sa U2U3UHUU U/U>UJU4U&45 UI( a UR SbU&S_WI45 UR 5 U
|
|||
|
|
R/ U&5 U S-
|
|||
|
|
n [
|
|||
|
|
Sc5 GM GMÞ [
|
|||
|
|
SeU SfU Sg35 GMò UR 5 [
|
|||
|
|
Sh5 g s snf s snf s snf ! [Z a GNHf = f! [b a0 nKURe 5 [
|
|||
|
|
SdU$ S8U& S%UK 35 S nKAKGM§ S nKAKff = f)iNz PRAGMA table_info(QuizQuestions)r) Úcorrect_answerszDALTER TABLE QuizQuestions ADD COLUMN correct_answers TEXT DEFAULT ''zL>>> Database Migration: Added correct_answers column to QuizQuestions table.z
|
|||
|
|
>>> Connecting to SQLite DB: z>>> Target Exam: z https://cbtbank.kr/category/r? r@ z'>>> Fetching list of exam rounds from: rA rB r+ rE z([Error] Failed to fetch exam page: HTTP r r r r z/exam/r< éÿÿÿÿ)ÚidÚnamer rh zFound z unique rounds on cbtbank.kr:z - ri z (ID: r z
|
|||
|
|
>>> Filtered to z selected rounds: zhttps://cbtbank.kr/exam/z3
|
|||
|
|
==================================================zScraping Round (z): zURL: z2==================================================z+ [Error] Failed to fetch round page: HTTP Úexams)Úclass_zN [Error] Could not find the questions container (class='exams') on this page.u ì�¼ë°˜r ÚclassÚ zexam-class-titleÚ:z
|
|||
|
|
>>> Subject switched to: z text-darkzexam-boxz question-idiÿÿÿz Question ID: z (Int: z) (z -> z!) already exists in DB. Skipping.z
|
|||
|
|
exam-titlez2 [Warning] Could not find exam-title. Skipping.ÚimgÚreplyzquestion-choiceÚsrcc 3 ó, ># • U H oT; v • M g 7f)N© )Ú.0Úxrq s €r& Ú <genexpr>Ú scrape_exam.<locals>.<genexpr>î s øé € ð +Cò >B¸°®8ò >Bùs ƒ)z kakao.pngzline.pngz facebook.pngz twitter.pngzband.pngz exam-numberz^[\s\.]+Úpassage)r r r r ÚolÚcorrectr
|
|||
|
|
z
|
|||
|
|
<img src="z" />é u 주관ì‹�z
|
|||
|
|
view-replyz
|
|||
|
|
reply-itemÚnickz
|
|||
|
|
reply-commentÚAIÚaiu ### 🤖 u AI 해설
|
|||
|
|
|
|||
|
|
r z**: z
|
|||
|
|
|
|||
|
|
---
|