bulk load - Loading Cassandra data with SStableloader from different Cassandra cluster -


i have 2 different independent machines running cassandra , want migrate data 1 machine other.

thus, first took snapshot of cassandra cluster on machine 1 according datastax documentation.

then moved data machine 2, i'm trying import sstableloader.

as note: keypsace (open_weather) , tablename (raw_weather_data) on machine 2 have been created , same on machine 1.

the command i'm using looks follows:

bin/sstableloader -d localhost "path_to_snapshot"/open_weather/raw_weather_data

and following error:

established connection initial hosts opening sstables , calculating sections stream input string: "compressioninfo.db" java.lang.numberformatexception: input string: "compressioninfo.db"     @ java.lang.numberformatexception.forinputstring(numberformatexception.java:65)     @ java.lang.integer.parseint(integer.java:580)     @ java.lang.integer.parseint(integer.java:615)     @ org.apache.cassandra.io.sstable.descriptor.fromfilename(descriptor.java:276)     @ org.apache.cassandra.io.sstable.descriptor.fromfilename(descriptor.java:235)     @ org.apache.cassandra.io.sstable.component.fromfilename(component.java:120)     @ org.apache.cassandra.io.sstable.sstable.trycomponentfromfilename(sstable.java:160)     @ org.apache.cassandra.io.sstable.sstableloader$1.accept(sstableloader.java:84)     @ java.io.file.list(file.java:1161)     @ org.apache.cassandra.io.sstable.sstableloader.opensstables(sstableloader.java:78)     @ org.apache.cassandra.io.sstable.sstableloader.stream(sstableloader.java:162)     @ org.apache.cassandra.tools.bulkloader.main(bulkloader.java:106)

unfortunately have no idea why?

i'm not sure if related issue, somehow on machine 1 *.db files name rather "strange" compared *.db files have on machine 2.

*.db files machine 1:

la-53-big-compressioninfo.db la-53-big-data.db ... la-54-big-compressioninfo.db ...

*.db files machine 2:

open_weather-raw_weather_data-ka-5-compressioninfo.db open_weather-raw_weather_data-ka-5-data.db

what missing? highly appreciated. i'm open other suggestions. copy command not work since limited 99999999 rows far know.

p.s. didn't want create overly huge post, if need further information me out, let me know.

edit: note i'm using cassandra in stand-alone mode.

edit2: after installing same version 2.1.4 on destination machine (machine 2), still same error. sstableloader still above mentioned error , copying files manually (as described lhwizard), still empty tables after starting cassandra again , performing select command.

regarding initial tokens, huge list of tokens if perform node ring on machine 1. i'm not sure those?

your data in form of snapshot (or backup). have done in past following:

  1. install same version of cassandra on restore node
  2. edit cassandra.yaml on restore node - make sure cluster_name , snitch same.
  3. edit seeds: list , other properties altered in original node.
  4. get schema original node using cqlsh desc keyspace.
  5. start cassandra on restore node , import schema. (steps 6 & 7 may not necessary, do.)
  6. stop cassandra, delete contents of /var/lib/cassandra/data/, commitlog/, , saved_caches/* folders.
  7. restart cassandra on restore node recreate correct folders, stop it
  8. copy contents of snapshots folder each corresponding table folder in restore node, start cassandra. want run nodetool repair.

you don't need bulk import data, it's in correct format if using same version of cassandra, although didn't specify in original question.


Comments

Post a Comment

Popular posts from this blog

authentication - Mongodb revoke acccess to connect test database -

i have ec2 instance mongodb 3.2.0 installed. have user admin access. can connect user , perform operation remotely. 1 can connect database test remote if knows ip mongo 11.11.11.11. although not able make operations, want restrict access user credentials can connect server. first need create users , grant roles users, example: use admin db.createuser( { user: "myuseradmin", pwd: "abc123", roles: [ { role: "useradminanydatabase", db: "admin" } ] } ) then need start server --auth parameter mongod --auth more information here
Read more

r - Update two sets of radiobuttons reactively - shiny -

i have read ( how make choices in radiobuttons reactive in shiny? ) shows me how update radiobutton s in reactive way. however, when try , update 2 sets of buttons same data, 1 set renders. example: server: # create example data wafer <- rep(c(1:3), each=3) length <- c(1,1,2,1,1,1,3,5,1) width <- c(3,1,6,1,1,1,1,1,6) dd <- data.frame(wafer, length, width) shinyserver(function(input, output, session){ # create reactive dataframe store data values <- reactivevalues() values$df <- data.frame() # lengths , widths of wafer user input <- eventreactive(input$do, { subset(dd, wafer %in% input$wafer, select = length:width) }) # update reactive data frame lengths , widths have been selected user input observe({ if(!is.null(a())) { values$df <- rbind(isolate(values$df), a()) } }) output$wl <- renderdatatable({ a() }) # update radio buttons unique length , widths stored in values$df # ever "observe" put first in co...
Read more

ios - Realm over CoreData should I use NSFetchedResultController or a Dictionary? -

i'm working on app using core data , nsfetchedresultcontroller many reasons switch use realm. saw there "realm version" of nsfetchedresultcontroller on github wouldn't compatible current code using core data. the view controller displaying list of people same school, address book. list sublist of people studied in same city. so thinking make 1 unique request database retrieve list of people , filter locally list within 1 dictionary per school [string: anyobject] string section name within tableview , anyobject array of people. first solution, make nsfetchedresultcontroller each school predicate filtering location. delete actions etc.. handled delegates -> not compatible realm create dictionaries , update them each actions... -> works realm it's annoying code. any better solution? edit: i need clarify request: i'd write class inherit uitableviewcontroller. this class has list of people sorted in alphabetical order the tableview has ...
Read more