Posts

bash - spark-submit: command not found -

a simple question: i try use bash script submit spark jobs. somehow keeps complaining cannot find spark-submit command. when copy out command , run directly in terminal, runs fine. my shell fish shell, here's have in fish shell config: ~/.config/fish/config.fish : alias spark-submit='/users/my_name/downloads/spark-2.0.2-bin-hadoop2.7/bin/spark-submit' here's bash script: #!/usr/bin/env bash submit_command="hadoop_user_name=hdfs spark-submit \ --master $master \ --deploy-mode client \ --driver-memory $driver_memory \ --executor-memory $executor_memory \ --num-executors $num_executors \ --executor-cores $executor_cores \ --conf spark.shuffle.compress=true \ --conf spark.network.timeout=2000s \ $debug_param \ --class com.fisher.coder.offlineindexer \ --verbose \ $jar_path \ --local $local \ $solr_home \ --solrconfig 'resource:solrhome/' \ $zk_quorum...

ibm mobilefirst - direct update failing in MFP 8.0 -

when trying direct update app getting below error. using mobilefirst 8.0.0.00-20170220-1900 [8/17/17 17:21:29:813 cdt] 000f8292 deploymentreg 1 com.ibm.mfp.server.core.internal.deployment.registry.deploymentregistryimpl getall:255 deploymentregistryimpl: getting all- type: com.ibm.mfp.server.core.internal.configuration.analytics.analyticsdynamicconfigurationimpl returned: [] [8/17/17 17:21:29:813 cdt] 000f8292 deploymentreg 1 com.ibm.mfp.server.core.internal.deployment.registry.deploymentregistryimpl get:198 deploymentregistryimpl: (one)- type: com.ibm.mfp.server.core.internal.configuration.analytics.analyticsdynamicconfigurationimpl returned: null [8/17/17 17:21:29:814 cdt] 000f8292 analyticsconf 1 com.ibm.mfp.server.core.internal.configuration.analytics.analyticsconfigurationdeploymenthandler getadditionalpackages:51 entering method: getadditionalpackages(). [8/17/17 17:21:29:814 cdt] 000f8292 analyticsconf 1 com.ibm.mfp.server.core.internal.configuration.analytics.analyticscon...

lambda - Best practices for storing data with Azure Functions -

Image
i've been working lot microservices , common pattern every service responsible own data. service "a" can not access service "b" data directly without talking service "b" via http api or message queue. now i've started pick work azure functions first time. i've looked @ fair few examples , seem have old function dabbling data in shared data store (which seems we're going old style of having massive monolithic database). i wondering if there common pattern follow data storage when using function service? , responsibilities lie? the following screen snippet example of event-driven distributed model of business processors in cloud-based solutions without using monolithic database. more details concept , technique can found in article using azure lease blob note, each business context has own lease blob holding state of processing references other resources such metadata, config, data, results, etc. concept allows create m...

jquery - css code issue using style and div no answer online -

would know how increase height of menu when scrolls on demo? part loads links? demo: http://tympanus.net/tutorials/collapsingsitenavigation know style css under submenu, make rise higher if that's possible? can help? appreciated. the top of ul slides in bottom being determined height given it. being uses jquery, hover effect , height change, not being done css. when browse css files using, see no indication of :hover or css transitions. wrong, best answer

ios - Custom init UIViewController query -

i hoping can me understand why below code segment works , other not. wanting create custom initialiser uiviewcontroller has custom nib file have created. my issue want understand why in below code references newmember , facebooklogin retained when hit viewdidload method in other segment of code not? can shed light why case? working code block class registrationformviewcontroller: miosbaseviewcontroller { var newmember:member! var facebooklogin: bool = false init(member: member, facebooklogin: bool = false) { self.newmember = member self.facebooklogin = facebooklogin super.init(nibname: "registrationformviewcontroller", bundle: nil) } required init?(coder adecoder: nscoder) { super.init(nibname: "registrationformviewcontroller", bundle: nil) } override func viewdidload() { super.viewdidload() let view = self.view as! registrationformview view.loadviewwith(member: newmembe...

How to use Python to analyse cvs file? -

Image
i beginner of programming, trying work out how average of elements in csv file. content of csv file: and code: import csv suburbs_average = {'north':0,'south':0,'east':0,'west':0} suburbs_count = {'north':0,'south':0,'east':0,'west':0} csvfile = open("ps1_3_data.csv") csv_reader = csv.reader(csvfile, delimiter=',') row in csv_reader: print (row[0],float(row[1])) print(suburbs_average) i have spent whole day trying figure out how calculate average of each suburbs(east,north...). need sort same suburb before calculate , how? please me on this? in advance. cheers. i working standard library think should stick can understand base implementations before installing modules willy-nilly. the csv module part of standard library, , reading docs learn each module capable of when looking solution. given problem, i'd following: iterate through csv.reader() object , put values d...

javascript - Swiper slider, pause html5 video when it's slide -

i using idangero.us swiper slider project. have 3 html5 videos in slider playing @ same time. need pause video when click next , play again when it's visible. html: <div class="swiper-container"> <div class="swiper-wrapper"> <div class="swiper-slide"> <video preload="auto" loop="" autoplay=""> <source src=".../> </video> </div> <div class="swiper-slide"> <video preload="auto" loop="" autoplay=""> <source src=".../> </video> </div> </div> </div> js: var swiper = new swiper('.swiper-container', { nextbutton: '.swiper-button-next', prevbutton: '.swiper-...