Posts by scottk:
fstab mounting cifs shares with spaces in the name
One of those evil things I run into is that people like to make shares with a space in the name. Â It’s not quite a banishment to one of the circles of hell offense, but I’m pretty sure you get some time in purgatory for it. So in order to fix it in fstab change that space to a \040
//WinFileServer/Share\040With\040Space /share/WTFWindowsAdmin cifs guest,domain=DOMAIN 0 0
Gluster’s got it wrong
“GlusterFS replication can happen on just 2 nodes as a minimum, as opposed to 3 with HDFS.” So this little tidbit was tucked into the Gluster marketing material for 3.3 Note that we use Gluster internally and it’s been a pretty solid system. That said, they need to do a little more research before they […]
Hadoop NameNode doesn’t want to share it’s blocks
Been running into a lot of the following errors in our Hadoop install org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hdfs.server.namenode.NotReplicatedYetException: Not replicated yet:/that_one_file/part-00000 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1268) at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:469) at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:966) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:962) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:960) at org.apache.hadoop.ipc.Client.call(Client.java:740) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) at $Proxy1.addBlock(Unknown Source) at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at […]
Bash loop for specific number of times
for val in $(seq 1 24); do echo “$val”; done
ip sysctl settings
/proc/sys/net/ipv4/* Variables: ip_forward – BOOLEAN 0 – disabled (default) not 0 – enabled Forward Packets between interfaces. This variable is special, its change resets all configuration parameters to their default state (RFC1122 for hosts, RFC1812 for routers) ip_default_ttl – INTEGER default 64 ip_no_pmtu_disc – BOOLEAN Disable Path MTU Discovery. default FALSE IP Fragmentation: ipfrag_high_thresh – […]
Burning in Greenplum cluster servers
In order to do some benchmarking for a Greenplum cluster I’ve modified the gensort program to generate a repeatable set of data that I can use to mimic impression and click data. I managed to put this to the test recently as we were breaking in some new hardware. The idea being to get the […]
You are replaced
So you’ve got a new Dell C2100 running a LSI 9260-8i and a drive craps out on you that was in a RAID5. Thus fa in order to replace it I’ve had to: Figure out which virtual disk is having problems >MegaCli64 -LDInfo -Lall -aALL Adapter 0 — Virtual Drive Information: Virtual Drive: 0 (Target […]
MegaCLI help output
Because I’m using this much more often than I expected MegaCLI SAS RAID Management Tool Ver 8.00.23 May 17, 2010 (c)Copyright 2010, LSI Corporation, All Rights Reserved. NOTE: The following options may be given at the end of any command below: [-Silent] [-AppLogFile filename] [-NoLog] [-page[N]] [-] is optional. N – Number of lines per […]
GP Sanity Test
New Greenplum instance running. Loaded 2 billion randomly generated rows equating to about 250G of data in 30 minutes. Analyze table and query on a non-indexed field. select count(1) from skahler.load_test where smallcode like ‘__A_’; count ———- 76940782 (1 row) Time: 4490.864 ms
LinuxCon 2010 Day one
It’s been a little over 24hrs since my arrival in Boston and my first day of LinxCon 2010 has come to a close. It been an interesting crowd to mill around with. I’ve seen everything from PR people to journalists to software developers and even spoken with someone who is working with the virtualization instructions […]