[OP-151] T#11127 Losing connection with Cassandra Created: 13/Jan/15  Updated: 09/May/18  Resolved: 15/Jan/15

Status: Closed
Project: Opush
Component/s: None
Affects Version/s: 3.0.4
Fix Version/s: 3.0.5, 3.1.0

Type: Bug Priority: Normal
Reporter: Antoine DUPRAT Assignee: Stephane COLSON
Resolution: Fixed Votes: 0
Labels: cassandra
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Story Points: 0.5
Rank: 11
Sprint: OBM Sprint 2015#2

 Description   

Pre-conditions

Opush 3.0.4 installed on another server than Cassandra.

Reproduction steps

Simulate a shutdown of the network on the Cassandra server.

tc qdisc add dev eth0 root netem loss 100%

when synchronizing with Opush, an error occurs which is a normal behaviour.

Then make the network up on the Cassandra server.

tc qdisc del dev eth0 root

when synchronizing with Opush, no error should occur.

Current behavior

An exception is reported in /var/log/opush/opush.log

11:45:19.408 [ERROR] {com.datastax.driver.core.Cluster} [t/c/r/] Unknown error during reconnection to /10.69.1.149:9042, scheduling retry in 32000 milliseconds
java.lang.IllegalArgumentException: rpc_address is not a column defined in this metadata
        at com.datastax.driver.core.ColumnDefinitions.getAllIdx(ColumnDefinitions.java:273) ~[cassandra-driver-core-2.1.2.jar:na]
        at com.datastax.driver.core.ColumnDefinitions.getFirstIdx(ColumnDefinitions.java:279) ~[cassandra-driver-core-2.1.2.jar:na]
        at com.datastax.driver.core.ArrayBackedRow.getIndexOf(ArrayBackedRow.java:69) ~[cassandra-driver-core-2.1.2.jar:na]
        at com.datastax.driver.core.AbstractGettableData.getInet(AbstractGettableData.java:169) ~[cassandra-driver-core-2.1.2.jar:na]
        at com.datastax.driver.core.ControlConnection.refreshNodeInfo(ControlConnection.java:429) ~[cassandra-driver-core-2.1.2.jar:na]
        at com.datastax.driver.core.Cluster$Manager$5.onReconnection(Cluster.java:1553) ~[cassandra-driver-core-2.1.2.jar:na]
        at com.datastax.driver.core.AbstractReconnectionHandler.run(AbstractReconnectionHandler.java:92) ~[cassandra-driver-core-2.1.2.jar:na]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_25]
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) ~[na:1.7.0_25]
        at java.util.concurrent.FutureTask.run(FutureTask.java:166) ~[na:1.7.0_25]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) ~[na:1.7.0_25]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) ~[na:1.7.0_25]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_25]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_25]
        at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]
  1. NOK

Expected behavior

No error in logs.

  1. OK

Additional informations

This is an issue from Cassandra driver which is already resolved.
We just have to upgrade our Cassandra driver.
https://datastax-oss.atlassian.net/browse/JAVA-546



 Comments   
Comment by Thomas HILAIRE [ 15/Jan/15 ]

QA: check reproduction steps
Impacts: none, I installed a version with this change on our production server the 14/01. Waiting to see if we encounter issues.

Comment by Jenkins Continuous Integration Server [ 15/Jan/15 ]

ABORTED: Integrated in opush-master-3.0 #21
OP-151 Cassandra driver 2.1.4 upgrade (thilaire: 8ba1d09e5f96c6df8dda6434759b4dff99c755a4)

  • push-dao-cassandra/pom.xml
Comment by Stephane COLSON [ 19/Jan/15 ]

I QA this

Comment by Stephane COLSON [ 20/Jan/15 ]

OK with Opush 3.0.5~rc2-1 (tested on Wheezy with OBM 3.1.2~0.alpha0+git20150119-1343-0330359

Comment by Jenkins Continuous Integration Server [ 26/Jan/15 ]

ABORTED: Integrated in opush-master #187
OP-151 Cassandra driver 2.1.4 upgrade (thilaire: 3f8fda785d58cb767a6b0dacc98942330acba0cd)

  • push-dao-cassandra/pom.xml
Comment by Jenkins Continuous Integration Server [ 03/Apr/17 ]

FAILURE: Integrated in opush-master #271
OP-151 Ugrade cassandra-unit (aduprat: 2c9b20b2cef6bba1e08beb973868becfff43f932)

  • push-dao-cassandra/src/test/resources/empty.cql
  • push-dao-cassandra/src/test/java/org/obm/push/cassandra/dao/OpushCassandraCQLUnit.java
  • push-dao-cassandra/src/test/java/org/obm/push/cassandra/CassandraSessionProviderTest.java
  • pom.xml
  • push-dao-cassandra/src/test/java/org/obm/push/cassandra/dao/CassandraSchemaDaoNoTableTest.java
Comment by myy (Inactive) [ 09/May/18 ]

http://www.oakleyslrc.com/, http://magic.nbajerseyssale.com/, http://www.bottega-venetasoutlet.com/, http://www.coachoutlet-online.com.co/, http://pacers.nbajerseyssale.com/, http://www.coach-factoryoutlet.net.co/, http://wizards.nbajerseyssale.com/, http://www.ok-em.com/, http://www.thomas-sabo.us.com/, http://www.moncler-jackets.com.co/, http://www.cheap-omegaswatches.com/, http://www.hoodiesoutlet.net/, http://www.co-aol.com/, http://www.northface-jackets.co.uk/, http://www.polo-ralphlaurens.com.co/, http://www.supra-footwear.net/, http://www.nikeshoes-canada.ca/, http://www.reebok-shoes.co.uk/, http://www.ralphslauren-polo.com.co/, http://www.lacoste-polos.us.com/, http://www.adidasshoes.com.se/, http://www.nikeroshe-run.com.es/, http://www.vansshoes-outlet.com/, http://www.pandorajewellery.com.es/, http://www.true-religionsoutlet.com/, http://www.coach-outlets.net.co/, http://www.barbour-jackets.us.com/, http://www.nike-freeruns.com/, http://www.timberland-shoes.fr/, http://www.nikeair-max.ca/, http://www.converse-schuhe.com.de/, http://www.outlet-pradabags.com/, http://www.mkoutlet.com.co/, http://www.burberry-store.com/, http://www.coachblackfriday.com/, http://www.parajumpersjacketsoutlet.com/, http://trailblazers.nbajerseyssale.com/, http://www.coach-outletonline.ca/, http://www.salvatoreferragamo.us.com/, http://www.basketballshoes.com.co/, http://www.long-champhandbags.com/, http://www.hollister.com.se/, http://www.giuseppes-zanottishoes.com/, http://knicks.nbajerseyssale.com/, http://www.cheap-juicycouture.com/, http://www.nhljerseys.com.co/, http://www.pandora-jewellery.com.es/, http://www.adidas-shoes.es/, http://www.eccoshoesoutlet.com/, http://www.levis-jeansoutlet.com/, http://www.converses.us.com/, http://www.air-maxschoenen.co.nl/, http://www.cheapjerseys-outlet.com/, http://www.converse-shoes-outlet.com/, http://www.toms-shoesstore.com.co/, http://www.hollister.com.de/, http://www.guci-heaven.com/, http://www.swarovskionlineshop.com.de/, http://www.bcbg-canada.ca/, http://dolphins.nfl-jerseys.org/, http://www.michaelkors.so/, http://www.rayban-sunglasses.co/, http://www.new-balanceshoes.es/, http://www.fidgetspinner.com.co/, http://www.bottega-outlet.com/, http://www.cheap-montblancpens.com/, http://www.oakleys-online.com.co/, http://www.oakley-sbocco.it/, http://www.soccershoes.us.com/, http://www.fitflop-outlet.com/, http://redskins.nfl-jerseys.org/, http://www.true-religions.com/, http://www.handbags-outlet.in.net/, http://raptors.nbajerseyssale.com/, http://www.michael-kors.com.es/, http://bears.nfl-jerseys.org/, http://www.adidassuper-star.com.de/, http://www.truereligions.net/, http://www.asicsoutlet.net/, http://www.ralph-laurenspolos.com/, http://www.polo-ralphlaurens.us.com/, http://www.oakleysunglasses-canada.ca/, http://vikings.nfl-jerseys.org/, http://www.raybans-outlet.co.nl/, http://www.rolexswatchoutlet.com/, http://www.celinefactory.com/, http://www.cc-beanies.us.com/, http://www.marc-jacobs.us.com/, http://www.nba-shoes.com/, http://www.horlogesrolexs.co.nl/, http://www.nikeairmax-australia.com/, http://www.jimmychoo-shoes.com/, http://www.kate-spadebags.com/, http://www.ralphlauren.mex.com/, http://www.timberland-shoes.net.co/, http://www.nike-shoes.com.co/, http://www.swarovskijewellery-au.com/, http://www.uggs-boots.com/, http://www.pandora-charmscanada.ca/, http://www.burberroutlet.co.uk/, http://www.philipppleins.us.com/, http://www.woolrich-jackets.com/, http://www.nikeairmax-shoes.fr/, http://www.okglassesale.com/, http://www.nike-shoesoutlet.us.org/, http://www.burberry-outlets.ca/, http://www.christian-louboutin.jp.net/, http://www.hollister-clothings.us.com/, http://www.michael-korsoutletonline.com.co/, http://pelicans.nbajerseyssale.com/, http://www.michaels-kors.co.uk/, http://www.nbateamonline.com/, http://www.watch-rolex.co.uk/, http://www.toms--outlet.com.co/, http://broncos.nfl-jerseys.org/, http://www.katespades.com.co/, http://www.thenorth-face.com.co/, http://www.christian-louboutin-shoes.com/, http://www.ralph-laurenpolos.com/, http://www.calvin-kleinoutlet.com/, http://www.skechers-shoesoutlet.com/, http://chiefs.nfl-jerseys.org/, http://www.cheap-pandoracharms.org.uk/, http://jets.nfl-jerseys.org/, http://www.montblancoutlet.com/, http://www.rolexwatchesforsale.us.com/, http://www.mcm-bagsoutlet.com/, http://www.hollister-outlet.com/, http://rockets.nbajerseyssale.com/, http://www.polos-ralphlauren.com.co/, http://www.ralphlaurens.co.uk/, http://www.cheapnhljerseys.us.com/, http://www.burberrys-outletonline.in.net/, http://www.monclers-outlet.us.com/, http://www.nike-factory.com.co/, http://www.tommys-hilfigers.net/, http://www.raybanoutlet.ca/, http://www.juicy-coutureoutlet.com/, http://nets.nbajerseyssale.com/, http://www.belstaff-outlet.com/, http://www.airmax-shoes.com/, http://colts.nfl-jerseys.org/, http://www.toms-outletonline.com.co/, http://www.dsquared2-outlet.com/, http://raiders.nfl-jerseys.org/, http://www.crystals-swarovskis.com/, http://www.birkenstock.net.co/, http://www.mcmshandbags.com.co/, http://www.armaniexchange.us.com/, http://www.versaces-outlet.com/, http://www.gucci-shoesoutlet.com/, http://hornets.nbajerseyssale.com/, http://www.cheapshoes.net.co/, http://www.jerseys.net.in/, http://www.hoganshoesoutlet.co.uk/, http://timberwolves.nbajerseyssale.com/, http://www.lonchamp.us.com/, http://www.pandora-jewelry.top/, http://celtics.nbajerseyssale.com/, http://www.mlbjerseys.com.co/, http://www.nikeairforce.com.de/, http://www.swarovski-canada.ca/, http://www.kate-spade-outlet.us.com/, http://www.kate-spades.net/, http://patriots.nfl-jerseys.org/, http://www.poloralphlaurens.com.de/, http://www.belstaffjacketsoutlet.co.uk/, http://www.oakleys-outlets.net/, http://www.coachoutletonline.vip/, http://azcardinals.nfl-jerseys.org/, http://pistons.nbajerseyssale.com/, http://www.pradas.com.de/, http://www.hugo-boss.com.co/, http://www.ralphslauren-polo.com/, http://www.chrome-heartsoutlet.com/, http://www.nike-shoes.org.es/, http://www.tods-shoesoutlet.com/, http://www.hermesbagsoutlet.com/, http://www.long-champ.com.co/, http://www.reeboks.com.de/, http://www.raybans-cher.fr/, http://www.outlet-true-religion.us.org/, http://www.burberry-storevip.com/, http://www.belstaff-jackets.us.com/, http://giants.nfl-jerseys.org/, http://www.salomonshoes.com.de/, http://www.prada-outlet.net.co/, http://panthers.nfl-jerseys.org/, http://www.chiflatironhair.us.com/, http://www.vans-shoesoutlet.co.uk/, http://www.the-north-face-jackets.com/, http://www.replicabags.net.co/, http://www.cheap-raybansoutlet.com.co/, http://www.swarovski-jewelrys.co.uk/, http://www.christian-louboutins.us.com/, http://www.soccershoes-outlet.com/, http://www.the-north-face.net.co/, http://coach.euro-us.net/, http://www.barbours.us.com/, http://www.nike-shoesoutlet.com/, http://titans.nfl-jerseys.org/, http://www.oakleyssunglasslrc.com/, http://www.versaceoutlet.us.com/, http://www.chiflatiron-hair.com/, http://www.cheap-iphone-cases.com/, http://www.linksoflondonvip.com/, http://www.tomsshoes-outlet.us.org/, http://www.ray-bans.org.es/, http://buccaneers.nfl-jerseys.org/, http://www.nike-airmax.in.net/, http://www.ferragamo.net.co/, http://www.converse-shoes.net/, http://www.soccers-shoes.us.com/, http://www.pandora-jewelry.com.de/, http://www.hollister-clothings-store.com/, http://www.outlet-pumashoes.com/, http://www.asicsshoes-outlet.com/, http://www.cheap-michaelkors.com.co/, http://www.rayban-wear.co.uk/, http://www.asics-shoesoutlet.net/, http://www.michaelkorspurses.co.uk/, http://jaguars.nfl-jerseys.org/, http://spurs.nbajerseyssale.com/, http://www.nikefree5.com.co/, http://www.nikeair-max.es/, http://www.valentino-shoesoutlet.us.com/, http://www.hogans.com.de/, http://www.nikeairmax.com.de/, http://www.michael-kors.co.nl/, http://www.michaelkors.com.de/, http://www.canada-michaelkors.ca/, http://www.nfl-jerseys.org/, http://www.oakley-sunglassessale.com.co/, http://www.australia-michaelkors.com/, http://www.outlet-michaelskors.com/, http://www.hollisterclothingcanada.ca/, http://www.birkenstocks.com.de/, http://www.raybans.com.de/, http://www.rayban-lunettes.fr/, http://www.outlet-true-religion.com/, http://seahawks.nfl-jerseys.org/, http://thunder.nbajerseyssale.com/, http://www.rolex-watchescanada.ca/, http://www.longchamp-outlet.com.co/, http://www.montrespascher.fr/, http://www.ed-hardy.us.com/, http://www.airhuarache-shoes.co.uk/, http://bulls.nbajerseyssale.com/, http://www.ray-bansoutlet.net.co/, http://chargers.nfl-jerseys.org/, http://www.outletburberry-bags.com/, http://steelers.nfl-jerseys.org/, http://www.omegas-relojes.es/, http://www.mbt-shoesoutlet.com/, http://www.coach-factory.com.co/, http://heat.nbajerseyssale.com/, http://www.airjordans-shoes.com/, http://bengals.nfl-jerseys.org/, http://www.mcm-backpacks.com.co/, http://www.christianlouboutinoutlet.net.co/, http://www.jewelrys-swarovski.com/, http://www.the-north-face.com.co/, http://www.guessfactorys.com/, http://hawks.nbajerseyssale.com/, http://www.burberrbags.co.uk/, http://www.christian-louboutinshoesoutlet.com/, http://packers.nfl-jerseys.org/, http://www.timberlandboots-outlet.com/, http://www.nikefrees-shoes.co.uk/, http://www.hermes-birkinoutlet.com/, http://www.nike-airmax.com.de/, http://www.nike-maxshoes.fr/, http://www.michael-kors.net.co/, http://www.ralphlauren-au.com/, http://www.nike-skos.com/, http://www.burberryoutlet-sale.net.co/, http://grizzlies.nbajerseyssale.com/, http://www.hollister-store.com.co/, http://bills.nfl-jerseys.org/, http://www.ray-bans.com.co/, http://www.cheap-baseballbats.us/, http://clippers.nbajerseyssale.com/, http://www.toms-shoe.us.org/, http://nuggets.nbajerseyssale.com/, http://www.polosoutlets-store.com/, http://www.new-iphonecases.com/, http://www.nike-shoes-outlet.co.uk/, http://www.barbours-factory.com/, http://www.thomassabos-jewelrys.org.uk/, http://www.burbagsoutlet.com/, http://www.cheap-watches.com.co/, http://www.tracksuits.com.co/, http://www.newbalance-canada.ca/, http://www.oakestore.com/, http://www.raybans-outlet.net.co/, http://www.oakleys.mex.com/, http://www.coachoutletonlinemall.com/, http://www.babylisspros.com/, http://www.omegaswatches.com/, http://www.rl-ralphlaurenpolos.co.uk/, http://www.adidas-shoes.ca/, http://www.burberbags.com/, http://rams.nfl-jerseys.org/, http://www.nike-free-runs.de/, http://warriors.nbajerseyssale.com/, http://coachoutlet.euro-us.net/, http://www.christian-louboutins.com/, http://www.outlet-michaelkors-online.com/, http://www.nfljerseys-sale.com/, http://www.nikeairmax-isc.co.uk/, http://www.adidas-shoes.com.co/, http://www.burberryoutletonline.com.de/, http://www.mcmbackpacks.com.co/, http://lions.nfl-jerseys.org/, http://www.hermesbags-outlet.com/, http://www.outlet-pradas.com/, http://www.ferragamos.us.com/, http://www.oakleyframeslrc.com/, http://mavericks.nbajerseyssale.com/, http://www.michaelkorsoutlet.se/, http://www.fredperrypolos.co.uk/, http://www.coachoutlet.fr/, http://www.outlet-tommyhilfigers.com/, http://www.nike-huarache.co.nl/, http://www.the-northface.com.de/, http://www.outletonline-michael-kors.co.uk/, http://www.nike-rosherun.co.nl/, http://www.bcbg-dresses.net/, http://www.nike-mercurial.com/, http://falcons.nfl-jerseys.org/, http://www.jordan-retros.com/, http://www.ralphlaurens.com.de/, http://www.michael-kors-bags.com/, http://www.ralph-laurens-polo.co.uk/, http://www.newbalanceschuhe.com.de/, http://www.barbour-jackets.in.net/, http://www.under-armour.us.com/, http://www.airmax.com.se/, http://www.coach-factorys.com/, http://cowboys.nfl-jerseys.org/, http://www.tommyhilfigers.co.nl/, http://www.nikeshoesoutlet.co.nl/, http://www.sac-hermes.fr/, http://www.skechers-canada.ca/, http://www.givenchy.com.co/, http://www.michael-korsbags.com.co/, http://www.longchamps-bags.us.com/, http://www.australia-uggs.com/, http://www.ferragamo-inc.co.uk/, http://www.cheap-mlbjerseys.us.com/, http://www.new-balanceoutlet.org/, http://www.oakley-outlet.fr/, http://www.air-yeezyshoes.com/, http://www.supra-footwears.com/, http://www.tommyhilfigers.de/, http://www.rosherun-shoes.us/, http://www.nike-paschers.fr/, http://www.michaelkors-ins.com/, http://www.tommyhilfiger-outlet.net/, http://www.outlet-ralphlaurens.com/, http://www.dsquared2s.com/, http://76ers.nbajerseyssale.com/, http://www.the-northface.in.net/, http://www.oakleys.com.de/, http://www.birkenstockshoes.com.de/, http://www.uhren-stores.de/, http://www.jack-wolfskin.us.com/, http://www.puma-shoes.com.de/, http://www.outlet-ralphlauren.co.uk/, http://www.timberland-boots.com.co/, http://www.the-northface.ca/, http://www.tommyhilfigerca.ca/, http://www.lauren-ralphs-outlet.co.uk/, http://www.raybans-outlet.cc/, http://www.pandora-jewelrys.com/, http://www.adidas-shoesoutlet.com/, http://www.prada-shoes.us.org/, http://www.ralph-laurenoutlets.com/, http://www.coachoutlet-coachoutletonline.com/, http://www.cheap-jerseys.mex.com/, http://www.fred-perrys.co.uk/, http://www.long-champ-outlet.com/, http://www.christianlouboutin-shoes.ca/, http://www.zccoachoutlet.com/, http://www.salvatore-ferragamos.com/, http://eagles.nfl-jerseys.org/, http://www.northfacejackets.fr/, http://www.jeans-truereligion.com/, http://www.outlet-michaelkors.com/, http://www.mizuno.us.com/, http://www.airmax2015.net/, http://www.raybansoutlet.co.uk/, http://www.rosherun-shoes.co.uk/, http://www.oakleys-sunglasses.com.co/, http://www.barboursjackets.com/, http://cavaliers.nbajerseyssale.com/, http://www.fendi-outlet.us.com/, http://www.skechers-outlet.com/, http://www.vansschuhe.com.de/, http://www.stone-islandestore.com/, http://www.scarpehogan-shoes.it/, http://www.airmax-90.com/, http://kings.nbajerseyssale.com/, http://www.jordan.com.de/, http://www.outlet-toryburchshoes.com/, http://bucks.nbajerseyssale.com/, http://www.adidasschuhe-online.com.de/, http://www.mk-com.com/, http://www.ralphlauren-canada.ca/, http://www.raybansasses.com/, http://texans.nfl-jerseys.org/, http://browns.nfl-jerseys.org/, http://www.marcjacobs-outlet.com/, http://www.nikerosherun.com.de/, http://www.the-northfacejackets.net.co/, http://www.michaelkorsoutletvip.com/, http://www.giuseppezanotti.com.co/, http://www.nike-store.com.de/, http://www.cheap-jordans.com.co/, http://www.airhuarache-inc.co.uk/, http://www.mcm-handbags.com.co/, http://www.tommy-hilfigers.de/, http://www.mizuno-running.net/, http://www.guccishoes.net.in/, http://www.toryburchs.us.com/, http://www.retrojordan-shoes.com/, http://www.nikerosherun.com.co/, http://www.michaelkorsoutlet.online/, http://www.coachoutlet-usa.com/, http://www.nikefreerun-inc.co.uk/, http://www.burberoutlet.com/, http://www.rolex-watches.us.com/, http://www.danskoshoes.in.net/, http://www.gbyguess.us.com/, http://jazz.nbajerseyssale.com/, http://www.ray-bans.net.co/, http://www.adidas-shoes.co.nl/, http://www.thomas-sabos.com.de/, http://www.coachfactory.cc/, http://www.louboutinshoes.jp.net/, http://www.jimmychoos-shoes.com/, http://michaelkors.euro-us.net/, http://www.designer-bags.us.com/, http://www.ralphlaurens.us.com/, http://suns.nbajerseyssale.com/, http://www.airjordanshoes.com.co/, http://www.burberryhandbagsvip.com/, http://saints.nfl-jerseys.org/, http://www.oakleysunglasses.org.es/, http://lakers.nbajerseyssale.com/, http://www.jerseys-store.com/, http://www.nikeshoes.de/, http://www.nike-shoes.com.se/, http://www.raybansbocco.it/, http://49ers.nfl-jerseys.org/, http://www.raybans-glasses.com.co/, http://www.replica-bags.us.com/, http://www.vibram--fivefingers.com/, http://ravens.nfl-jerseys.org/, http://www.nikeshoes.mex.com/, http://www.oakleys-lrc.com/, http://www.under-armouroutlet.com/, http://www.toms-shoesoutlets.com/, http://www.long-champ.com.de/, http://www.eyeglassesinsale.com/, http://www.softballbats-sale.com/, http://www.jackwolfskinoutlet.ca/, http://www.oakley-outletonline.com.co/, http://www.new-balanceshoes.com/, http://www.lacosteoutlet.com.co/, http://www.oakleysoutlet.com.co/, http://www.nbajerseyssale.com/, http://www.philipp-pleins.org/

Generated at Sun Aug 18 04:47:39 CEST 2019 using JIRA 6.1.1#6155-sha1:7188aeec9a6b57d61ea04c52f235f15f55c105e2.