Wc@s+ddklZddklZddklZddklZddkZddkZddkZddk Z ddk Z ddk Z ddk Z ddk Z ddkZddkZddkZddkZddklZddklZdefd YZd Zed jo endS( i(tContentClassHandler(t ElementTree(t BaseClass(tCommonN(tFileSync(tCMSVersionDeploymentPolicytDeploycBseZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZdZdZdZdZRS(cCs]ti|ttt|jo|i|tn ||_|id|_ dS(N( Rt__init__ttypetstrtloadJsonConfigtTruetconfigtinitParameterstNonet combinedPath(tselftinputfileOrObject((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyR&s    cCs ||_dS(N(R(Rtpath((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytsetCombinedConfigJsonPath/scCsyd}|d}|d}ti|}td|}t|pdSti|d|d|d|ddS(Ns/opt/tandbergtv/cms/workflows /rejecteds /templatescSs d|jS(s Target Title((tt((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyt8st/i(tostlistdirtfiltertlentrename(Rtworkflowtrejectedt templatestdirlistttt((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytcheckTargetTitle2s   cCs0|o%x"|D]}|i|dqWndS(NR(tdeleteConfigFilesViaDirectory(RtconfigFileToRemoveDirectoriest configFileDir((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytdeleteConfigFiles>scCsxtitii|D]h\}}}xV|D]N}|i||tii||}tii|oti|q2q2WqWdS(N(RtwalkRtabspathtgetTargetFilePathtjointexiststremove(Rt directoryt targetDirRtdirstfilestfilenamettargetFilePath((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyR"Cs$cCs3|o(x%|D]}|i|d|qWndS(NR(t!copyResourceFilesAndReplaceParams(RtconfigFileDirectoriestparamsR$((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytcopyAllResouceFilesJscCs|idxtitii|D]\}}}x|D]}tii||}|i|||} tii| pAti| | i ddjo|i dd| t qq?q?Wx(t i |dD]} | idptii|| } t| ii} z| ~ } | i}WdQXd|joU|dj oDt|o7x4|D](}|id|d d |d }qhWqn|i||| }|d }t|d ii}zJ|~} | i||i ddjo|i dd|t nWdQXtii|p%ti|||id|qtit|ii}tit|ii}||jo2|i|ti|||id|qti|qqWq)WdS(NsECopying all file from resource directory and replace with parameters.s/opt/itnobodyt*s.svnts${tNAMEt}tVALUEs.tmptwsFile not exists, create file: s*File changed, backup and over write file: (toutputRR&RR'R)R(R*tmkdirtfindtchownR tfnmatchRt startswithtopent__exit__t __enter__treadRRtreplacetwritetshutiltmovethashlibtmd5t hexdigestt backupFileR+(RR,R-R4RR.R/tdirtdirpatht saveDirpathR0tfilepatht_[1]tftstparamt finalFilepathttempSaveFileptht_[2]t oldFilemd5t newFilemd5((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyR2OsL  "# . &  !!  cCs|||i|t|S(N(tindexR(RR,R-RR((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyR(vsc Cs|djpt| odSg}g}x<|D]4}|i|o|i|q3|i|q3WdGH|GHdGH|GHd}t|di}t|d}x|D]}|ip|i|qnt}t} xA|D]9} x0|i D]"} | | djo t }PqqWqWxA|D]9} x0|i D]"} | | djo t } PqAqAWq.W| o/| o'd|dd !|fGH|i|qqWx-|D]%} |id | d | dfqW|i dS( Ns%The following hosts will be deleted: s.The following hosts will be added or updated: s /etc/hoststrR<R9sadd host(%s) to %siis %s %sR;( RRt getIsDeletetappendtfilet readlineststripRHtFalsetrsplitR tclose( RthoststtoBeDeletedHoststtoBeAddedHoststhosttfnt existingHostst newHostFiletdeletetupdatettoBeDeletedHostthostPartt toBeAddedHost((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytconfigureResourceHostsysX      #c CsatiGH|djodSti}|i|ix$|D]}|idp d}n |d}|idp d}n |d}|idp d}n |d}|idp d}n |d}|idp d}n |d}|i|d|dt|d |d |d ||||||d t|d |i | q=WdS(NtcommandParametertmessageParametert routingDirtt failureDirtlooseFileNamePatternRRt frequencyt processClasst messageUIDteventstthreads( Rt isOverrideRtWatchFolderConfigurationRNtfilePaththas_keythandleR R^( Rt watchfolderstwfctwfRsRtRuRwRx((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytconfigureWatchfolderss.            cCsg|djodSti}|i|ix2|D]*}|i|d|d|i|q5WdS(NR9tGROUPS(RtDistTemplateConfigurationRNRRR^(RRtdtttemplate((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytconfigureDistTemplatess  cCsn|djodSti}|i|ix9|D]1}|i|d|d|d|i|q5WdS(NtHOSTtUSERtPASSWORD(RtFTPConfigurationRNRRR^(Rt ftpConfigtfcRT((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytconfigureFTPConfigs  cCsN|id}|dj o.|idjotiddiGHndS(Nt setupSFTPttruessh scripts/SetupSFTPUpload.shR](t getConfigRtlowerRtpopenRF(RR R((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytsetupSFTPUploads cCs:|o/tidjo|iddd|iddiddd|idd d |idd d|idd }tid |ddi|ddiGHq6tii }x\|D]T}d|GHt |di i }z&|~}|i i|iWdQXqW|indS(Ng@toracletuserRtpasswordt$s\$t@Rit:tporttsidssh scripts/DataPatch.sh s "t t"R]sStarting to execute datapath: (Rt getCMSVersionR RGRRR)RFtgetPrepackDepolymentPolicytgetDatabaseConnectionRCRDREtcursortexecutetcommit(RtsqlFilest dbSettingst connectiontsfRSRT((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyt doDataPatchsi4 &#c CsZt}|id|iid}d}d}x/|D]'}|iddjo |i}q>q>Wx/|D]'}|iddjo |i}qpqpW|djo|djo|i}tii |d|p7ti |d||i d d |d|t nd |}|i |d||tid d d d |fndS( Ns4/opt/tandbergtv/cms/workflow/preferences/batonqc.xmltentryRvtkeys report.enablesreport.symbolic.link.nameRRR6s8/opt/tandbergtv/watchpoint/tomcat/webapps/baton-reports/schown %s%s:%s %ss-h (Rtparsetgetroott getiteratortattribttexttgetMountPrefixRRR*R>R@R t createSymlinkR(Rttreetentriest reportEnabletsymbolicLinkNametet mountPrefixt linkFilePath((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyt configureBatonReportSymbolicLinks*   " cCs$t}|id|iid}d}d}x/|D]'}|iddjo |i}q>q>W|djo|djo|i}tii |d|p7ti |d||i d d |d|t nd }|i |d||tid d d d |fndS( Ns5/opt/tandbergtv/cms/workflow/preferences/verifier.xmlRRvsverifier-reportsRs report.enableRRR6s:/opt/tandbergtv/watchpoint/tomcat/webapps/verifier-reportsschown %s%s:%s %ss-h (RRRRRRRRRR*R>R@R RR(RRRRRRRR((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytconfigureVerifierReports"   "cCs\t}|id|iid}x*|D]"}|iddjo|iSq2WdS(Ns3/opt/tandbergtv/cms/workflow/preferences/system.xmlRRs mount.prefix(RRRRRR(RRRR((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyR#s  cCsCdd|}d|}|id|i|ti|dS(Ns8/bin/rpm -Uvh --ignoreos --nodeps --force --replacepkgs srpms/%sscommand=sRPM installing.(R=Rtsystem(RtrpmNamet RPMCMDLINEt outputstr((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyt installRpm+s    cCs|idddt|idg|idtidtid|iddd d d d d dg}t|i||id|idddt|iddddddg}t|i|x$|D]}|idd|tqW|i|i dS(Ntroots /etc/vsftpdtvsftpdsConfigure ftpusers ads and iptvsCuseradd -d /content -m ads -p \$1\$Z6Giw8dM\$inoJyvC6w/7q27ukZabZB.sKuseradd -d /content/ftp -m iptv; (echo iptv123; echo iptv123) | passwd iptvs0Verify and correct /content required directoriess /content/adis/content/unmappeds/content/mappeds/content/deriveds/content/uploadeds/content/txns_temps /home/cms/adisCreating FTP directoriesR6s#Creating Content Ingest directoriess /content/datas/content/data/temps/content/data/dists/content/data/faileds/content/data/ingest( R@R trestartLocalServicesR=RRtmaptmakeDirRR (Rt contentDirstdataDirsR,((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyt initialSetUp2s6        cCsd}ttid}|djo |GdGHnxtoyttid}|djo dGHPndG||GdG|GH|d}tid|d jotd q8q8WdS( Nis&/opt/tandbergtv/cms/workflow/templatess#templates are not ready, waiting...sAll templates are ready nowsIngested templates:RiiihsYTemplates are not ready!!! please check the path "/opt/tandbergtv/cms/workflow/templates"(RRRR ttimetsleept RuntimeError(Rt retry_timestcountt cnt_templates((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytwaitForAllTemplatesIngested[s      cCs|idd}|idd}g}g}|iddj o|id}n|iddj o|id}nt|p t|oUh}xE|D]=}|d|ijo |ih|d|d6qqWxE|D]=}|d|ijo |ih|d|d6qqWx|iD]}g} |iiodti |} | djoDd t |t i d d } ti | | ||| g} qnxP|D]H}||djo1| g} |d D]} | | d q~ } qqWg}xP|D]H}||djo1|g}|d D]} || d qF~}qqWd|dt i d d }d|dG| G|GHti| ||ti||||ti||||iiq=WndGHdGHdS(NtcmsRRtcontentClassestcontentClassesToDeleteR9t DESCRIPTIONitcurrent_content_class_s %Y%m%d%H%M%Ss.xmltCONTENTCLASSFILEStFILENAMEtfinal_merged_content_class_t_smerge content class for s: sContent class no change.sImport content class completed!(R RRRtkeysRnthelpertcontentClassEverImportedRtgetContentClassIdByNameR Rtstrftimet exportByIdtmergeContentClassestaddHeadOfContentClasstimportContentClasst!writeContentClassImportedFlagFile(RtusernameRtmer_ct_cls_listtdel_ct_cls_listtcontentClassesListtmer_ct_cls_itemtdel_ct_cls_itemt ct_cls_itemt mer_ct_clst ct_cls_idt cur_cls_pathRStct del_ct_clsRYtxmlPath((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyRlsX$$  !55cCs6tidjoti}|idGHndS(Ng@sDatabase schema update done.(RRtDatabaseSchemaExecutorR(Rtdse((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytupdateDatabaseSchemas  cCsfdGHd}|dtid}ti|tid|dtid|dtid |d tid |d |d }ti|tid|d|ti|d|dti|d |d ti|d |d ti|d}|i ti|d|dtid|d|dti|dddGHdS(Ns'Start to repacking cms ear for CMS 5.2.t ear_workspaceRs %Y%m%d%H%M%Ss4/opt/tandbergtv/jboss/standalone/deployments/cms.ears/cms.ears>/opt/tandbergtv/jboss/standalone/deployments/rulesservices.wars/rulesservices.wars=/opt/tandbergtv/jboss/standalone/deployments/siteservices.wars/siteservices.warsH/opt/tandbergtv/jboss/standalone/deployments/prepack_device_services.wars/prepack_device_services.wars/cms.ear.extractsunzip s /cms.ear -d s/META-INF/application.xmls /cms-old.ears jar -cvf s /cms.ear -C s .s%Finish repacking cms ear for CMS 5.2.( RRRtmakedirsRIRJRtcopytCMSEarApplicationXmltaddPrepackModules(Rtear_workspace_dirtcur_workspace_dirtcur_ear_extract_dirtapplicationXMLHandler((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytrepackageCMSEarWithPrepackWars*    cCstiptin|id|i|i|itidj o|idtin|idt i djo*|i ddg|i ddgn!|i dg|i dg|i |id|id }d }|dj ot|oxd|D]\}y"|i|d ti|Wqtij o"|id |d d}qXqW|djo|idtidqn|i|id|id}g}|o|i|}n|id}|dj o/t|o"x|D]}|i|q!Wn|id}|dj o/t|o"x|D]}|i|qlWn|id} | dj o/t| o"x| D]}|i|qWn|id} | dj o/t| o"x| D]}|i|qWn|id} | o"x| D]}|i|q:Wntip|in|o|i|n|id|id} | dj oEt| o8x5| D])} |i| |idd| tqWnt i djo|idgn|idg|i|i |i!|id|i"|id|i#|id|i$|id|i%|id|i&|id|i'|id |i(|id!|i)|id"|i*|id#|i+|i,|id$|i-|id%|id&|i.|id'|i/|id(|i0|id)|i1|id*t i2|i3|i4|i5|id+|i6|id,|i3dd-|i3dd.|i7|id/o|i8n|id0o|i9n|i|id1|i:|id2|id3o|id4d5dk;}d6|i<d7}|i=|d8td9|i>d:|i?}|i@iA}x|D]}|i|qW|id;n|id<o|id= p8|id=iBd>joU|id=iBd?jo9|id<GHtC|id<iD}|ptESn|id@dddg|iFd@dddg|idAtS(BNs deploy for sMode: s g@RttomcatRt resourceHostst hostnamesis = t's-' is not a resolvable hostname, please fix...is exiting...tpreInstallationScriptstAdapterPropertiestresourceTypeRpmstresourceGroupRpmst templateRpmst otherRpmst commonRpmssCreating required directoriestdirectoriesToCreateR6t rpmsToDeletettemplateToDeletetruleSetsToDeletet selectorKeyst customFieldst resourcestresourceGroupsAllocationtsitestalertst meprofilestconfigFileToDeleteDirstconfigFileDirsR4t distTemplatesRRtqueriestpartnerstruleSetsRRtbatonReportEnabletverifierReportEnabletpostInstallationScriptstdataPatchSqlFilestconfigMigrationStepss%Start configuration file migration...isYsh /opt/tandbergtv/cms/scripts/config-migration-tool-cmd/bin/config-migration-tool.sh -i s -stshelltstdouttstderrs&Finish configuration file migration...tcluster_app_nodestignoreFileSycntYtYESRsDeployment complete.(GRtisFreshInstallRt setOverrideR=tnametinstallerVersiont installModeRRRtstopServiceInClusterNodeststopLocalServicesRrRRtsockett gethostbynametgaierrortsystexittexecuteScriptstbackupFilesToRestoreRt isUpgradeModeRtrestoreBackupFilesRR@R RRtwaitForOtherServersAvailablet unstallRpmstdisableProcessDefinitionstdeleteRuleSetstinsertSelectorKeystinsertCustomFieldsGroupstinsertResourcestupdateResourceGroupsAllocationt insertSitest insertAlertsthandleMeSubsProfilest restartAlertsR%R5RRRtconfigureDatabasetinstallAndConfigureReportsR RtinsertPartnerst importRulest sortRuleSetRRRt subprocessRtPopentPIPEtSTDOUTR#RatupperRtdosyncRctrestartServiceInClusterNodes(Rt dnshostnamestfailurethostnamet adapterPropstbackupFilePairsRRTRR R R R R,RJtcmdtptlinestlinetsync_successed((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytdeploys  "         " 2   '!  (t__name__t __module__RRR!R%R"R5R2R(RrRRRRRRRRRRRRRRR[(((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyR%s0     '  6 "       )  ,  cCs:td}td}|iti|idS(Ns8/root/prepack-aio-master-SNAPSHOT.1698/scripts/file.jsonsC/root/prepack-aio-master-SNAPSHOT.1698/scripts/deployMERuleset.json(Rt initPolicyRR*R[(R[((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pytmainys     t__main__(t FileAssemblerRtxml.etree.ElementTreeRRRRRRRRRARKRRIR0R3RtfilesyncRRRR_R\(((s`/home/jenkins/workspace/prepack-aio-release-4.2/prepack-aio/src/main/resources/scripts/deploy.pyts.            V