Archive for February, 2007

ILO minimum firmware version supported

http://h18023.www1.hp.com/support/files/lights-out/us/revision/6147.html

The firmware update, Version 1.82, contains critical bug fixes and is the minimum version required. Please perform the update at your earliest convenience. Click on the underlined Version to view more details on the fixes.  

You can upgrade the firmware remotely and online easily, I posted an example script. I’ve done this before without issue, it’s worth doing to fix the bugs and avoid any issues from a support angle in the future, think about the system firmware as well, it should be updated at some point, maybe your next security patching process?  Or when the system is down for an upgrade/maintenance.

Also, remember the array firmware, this can be quite important but for the older legacy compaq proliants (1850/6500/2500/1600) you might find the individual disks might need their firmware upgraded, and that can involve the 16 floppy disk scenario. On anything G1/G2 and above you’ll be fine typically, apply firmware ILO, system, array and reboot.. Do test it first though, and not on production until you’re happy.

Configuring the ilo remotely in linux

http://h18023.www1.hp.com/support/files/server/us/download/25349.html

HP Lights-Out Online Configuration utility is a command line utility used to configure iLO and RILOE II from within the Linux operating system without requiring a reboot of the server. 

This contains the binaries to download in order to install and run the ILO config utility for linux, hponcfg.

The utility allows you to output the current configuration to a file, to reconfigure from an input file or to reset the ilo if it isn’t responding. A very useful tool, whether for use during the build process or in a support, get the config kind of situation.

I need to reinstall linxu on my DL360 to try it, but if it is as easy as the windows one, configuring the ilo with an input file shouldn’t be difficult.

IBM continues to deliver

http://www.prdomain.com/companies/I/IBM/newsreleases/200722739266.htm

IBM Maintains Leadership in Blade and UNIX Servers  
26 Feb 2007 , Armonk, NY : IDC reported today that IBM (NYSE: IBM) continues to hold the number one position in worldwide server revenue share with 32.8 percent revenue share for 2006 [1].

IBM’s leadership position in global server revenue in 2006 was augmented by noteworthy revenue growth in its System z™ mainframe business [2].

In 2006, IBM introduced the System z Business Class mainframe, teamed with industry leaders such as Oracle and SAP to drive innovation on the platform, and extended its customer base and drove new workloads onto the platform through specialty processors for Linux® and Java™ workloads.

IBM continue to offer a competitive, scalable and adaptable blade infrastructure solution, I know their x86 and the power range of blades have been attractive alternatives on the blade market, good to see them doing well. The more choice the customers have, the more chance that we will be able to choose and find a solution comprised of blade technologies. Regardless, as long as IT delivers, what it runs of is of little significance in the grand scheme of things.

Switching systems saves money

http://www.infoworld.nl/idgns/bericht.phtml?id=002570DE00740E180025728F0004636C

Wealth management technology firm IWL Limited has overhauled its Sun Microsystems server and storage environment and replaced it with IBM hardware, a move that has led to a six fold improvement in application performance and significantly reduced maintenance costs.

Executive general manager of infrastructure and services at IWL Limited, Phil Moore, estimates cost savings in the range of $300,000 per year (US$79,000).

The company replaced existing Sun Microsystems servers running Solaris with IBM System x3950 and System x 3550 servers, as well as IBM BladeCenter chassis and HS20 Blade Servers running Red Hat Enterprise Linux.

It also replaced its existing storage with an 18TB IBM System Storage DS4800 storage area network and an IBM System Storage TS3500 tape library.

A phased rollout over six months was completed in January 2007.

Moore said the entire infrastructure was replaced and the total project cost was $1.7 million with $1.3 million going to IBM.

“The core infrastructure we inherited was four or five years old, it wasn’t delivering the performance we needed and most of the equipment was out of warranty,” he said.

Looking at how your IT is provided, what technologies and vendors are used is the cost of doing business, whether this means changing vendors, changing the way you purchase your servers, or through virtualization, focussing on a more effective way of supplying IT to the business is key to good information management.

HP improves it’s blade solutions

http://www.hp.com/hpinfo/newsroom/press/2007/070227a.html

HP Reduces Customer Administrative Costs and Wait Time with Blade Network Virtualization Technologies

PALO ALTO, Calif., Feb. 27, 2007 On the heels of taking the No. 1 position in factory revenues and units shipped for blade servers,(1) HP today introduced virtualization technologies that simplify the connectivity and management of its HP BladeSystem c-Class architecture, the company’s core solution for the next-generation data center. HP also announced the launch of its first workstation blade for the c-Class blade portfolio, the HP ProLiant xw460c Blade Workstation, to provide users with increased performance and scalability.

Dramatically simplifying network connectivity and common server management tasks across the data center, the HP Virtual Connect Ethernet and Fibre Channel virtualization modules enable administrators for the first time to wire just once and then add, replace or recover servers on the fly. In addition to lowering capital and operating costs, the modules deliver simplified management capabilities that reduce the time it takes to execute these actions from hours or days to a matter of minutes.

The XW460c blade workstation does look fantastic, the HP trader workstation range, the XW6000-9400 have been infamous in the banking sector as industrial strength, I’m sure HP will offer the same with their blade workstations, the technology has been tested now, one of the banks is already using them.

Virtual connect looks very interesting and it’s worth checking out their web seminar or reading the text for the press release, though http://h71028.www7.hp.com/enterprise/cache/459411-0-0-0-121.html does explain it very well, it aims to use the technologies available to reduce the lead time in deploying infrastructure which does look very good and I am very impressed. Will need to read the whitepapers to find out more.

What’s this robocopy stuff?

http://en.wikipedia.org/wiki/Robocopy

Robocopy, or “Robust File Copy” as it calls itself, is a command-line file copying tool introduced as a standard feature of Windows Vista, but which beforehand has always been available with the Windows Resource Kit, free to licensed users of Windows. Robocopy is designed for reliable copy or mirroring of entire folders of any size ensuring all NTFS attributes and properties are copied (except security-related ones unless specifically requested), particularly over network connections that are subject to disruption or outages. Robocopy’s default settings are geared for this purpose, whereas other built-in utilities such as XCOPY require numerous command line switches in order to get this behavior. Copying of security information is supported, but isn’t default and requires an explicit /COPYALL switch.

Robocopy is an excellent tool for making sure that the files you want copied are copied as requested, for logging the copy, for copying security permissions. It’s basically the way to copy files between windows servers/desktops, and doesn’t require a lot of experience/expertise.

  • Robocopy c:\temp d:

Copies the C:\temp folder to your D drive, there are options which you can set, they are both on the wikipedia url above or if you do robocopy/? in dos

Why would you do this?

  • To copy data to a new volume
  • Data consolidation
  • Data cleansing/anti virus/defragmentation - robocopy to temporary area format the drive, and robocopy data back
  • Sync data between locations
  • Move data between locations

Follow the sun continued

Inefficient use of resources

Follow the sun allows a more dynamic IT support model, one where we can share at the very least first and maybe second line support overnight allowing your local team to be on call, but at the same time not be up all night unnecessarily if the issue can be dealt with by whoever is working at that part of the business day.

Poor Global Support

Often a system might have dependencies on systems in other locations, for example, the London batch might be dependent on the Singapore system being available, often you might find that the application teams have access to the systems in Singapore, but the infrastructure don’t, so when the system goes down, someone in Singapore has to be paged, causing delays to the resolution time. If I had the password/access, I might be able to log on and check what’s going on, do my best to stabilize the platform for the time being.
 
Everybody thinks local

IT thinks differently in different locations, which makes deploying systems that bit harder, the fact that Singapore might use Hitachi storage, or they don’t buy HP, they buy Dell, makes the support, the project implementation that bit harder, and standards might vary between sites. By bringing the IT teams together in a follow the sun model, we can’t change everything and make everything equal, but we can move towards a standardised approach, an agreed way of building a cluster, how we deploy, and build blades. The idea being that if Capital Markets request a blade in London, it should be as close to identical as the blade in Singapore.

 

Follow the Sun Support

In the olden days, London Windows Support looked after London servers. New York looked after New York servers, and so on, the lines or regional demarcation were set. The problem with this is as follows:

  • Inefficient use of resources
  • Poor global support
  • Everybody thinks local - that’s not how we do it here.

As business needs grew, this model became redundant in some of the large banks, some of the IT departments decided to operate with the business lines in a follow the sun approach. This being that the infrastructure support, the IT follows the sun, however is up, supports the systems, however is asleep does not. The idea being that a server failing at 3am London time should not mean that we need to get a London server engineer up, firstly the New York engineer, can log on see what’s going on and attempt a fix, escalating to London if necessary, key to this is an effective operations team, effective dialog between the teams, and understanding each regions way of working, until we can move towards a state where a server built in London is identical to one in France, one in New York etc.

Documenting blade cabinet layout

http://web.mac.com/martinmacleod/iWeb/Site/Blog/bladecab_layout.pdf

As you deploy blade enclosures, keeping a note of what the layout looks like, and what they are being allocated too is important. I’ve put together a basic example for a deployment, consisting of 48 HP blades, note the same would apply to IBM/Sun/Dell though the number of blades might differ. The diagram gives you an example of the cabinet layout for BL30p/BL35p blades.

Try and operate on an enclosure basis, allocating individual blades to a task can make administration that bit more difficult and couple that with naming conventions and the game might be over. Remember, that you may have to take down a cabinet for maintenance, trying to minimize the number, the range of applications will make this easier, or at the very least sharing that cabinet between a business line, suite of applications.

Installing Nagios Agent on Windows

http://www.nagios.org or http://www.nagiosexchange.org/Windows.49.0.html?&tx_netnagext_pi1%5Bp_view%5D=64

Nagios is an open source monitoring tool which works on several platforms including windows and linux. I’ve deployed on windows 2003, here’s an example script:

  • c:
  • cd\progra~1
  • md nagios
  • robocopy /s \\buildserver\share c:\progra~1\nagios
  • cd nagios
  • nrpe_nt -i -n -c nrpe.cfg
  • net start nrpe_nt

This script does the following: go to C:\program files directory, create nagios directory, copy the config files, run the service install and start the service.

Nagios might be something you consider if you are scaling up your blade infrastructure and the cost of the monitoring tools against the benefit is becoming an issue for debate. Think about which blades you need monitored and consider that you might not need everything monitored, just those key blades/servers within your solution.