19.4 Migrating Your Database to Newer Versions of Moab
Sometimes when upgrading from an older version of Moab to a newer version, you must update your database schema. If the schema Moab expects to operate against is different from the actual schema of the database Moab is connected to, Moab might not be able to use the database properly and data might be lost.
When upgrading the Moab database schema from an old version, you must perform each version upgrade in order. You cannot skip versions. For example, to migrate from version 6.1 to version 7.2, you must follow the steps in Migrating from Moab 6.1 to Moab 7.0, Migrating from Moab 7.0 to Moab 7.1, Migrating from Moab 7.1 to Moab 7.2, then Migrating from Moab 7.2.x (where "x" is 5 or lower) to Moab 7.2.6.
19.4-A Migrating from Moab 7.2.x (where "x" is 5 or lower) to Moab 7.2.6
In Moab 7.2.6, several columns were extended and the primary key on the Triggers table changed. To upgrade your database with these changes, use the moab-db-<database>-upgrade7_2_6.sql file located in the contrib/sql directory in the root of the binaries. For example, to migrate your MySQL database from the 7.2.x (pre-7.2.6) schema to the 7.2.6 schema, run the following:
mysql -u root -p < moab-db-mysql-upgrade7_2_6.sql
Similar migration scripts exist for Oracle and PostgreSQL.
19.4-B Migrating from Moab 7.1 to Moab 7.2
In Moab 7.2, several events in the event table related to the Accounting Manager were renamed. To upgrade your database with these changes, use the moab-db-<database>-upgrade7_2.sql file located in the contrib/sql directory in the root of the binaries. For example, to migrate your MySQL database from the 7.1 schema to the 7.2 schema, run the following:
mysql -u root -p < moab-db-mysql-upgrade7_2.sql
Similar migration scripts exist for Oracle and PostgreSQL.
19.4-C Migrating from Moab 7.0 to Moab 7.1
In Moab 7.1, Offset was renamed TriggerOffset in the Triggers table. To upgrade your database with these changes, use the moab-db-<database>-upgrade7_1.sql file located in the root of the binaries. For example, to migrate your MySQL database from the 7.0 schema to the 7.1 schema, run the following:
mysql -u root -p < moab-db-mysql-upgrade7_1.sql
Similar migration scripts exist for Oracle and PostgreSQL.
19.4-D Migrating from Moab 6.1 to Moab 7.0
In Moab 7.0, the Moab table has been removed from the database, and a MoabInfo and JobHistory table have been added to it. To upgrade your database with these changes, use the moab-db-mysql-upgrade6_1.sql file located in the contrib/sql directory in the root of the binaries. This is done by running the following command:
mysql -u root -p < moab-db-mysql-upgrade6_1.sql
Your MySQL database is updated for Moab 7.0.
19.4-E Migrating from Moab 6.0 to Moab 6.1
An Events table has been added to the database in Moab 6.1. Update the contrib/sql/moab-db.sql file with the following table:
CREATE TABLE Events ( ID INTEGER, ObjectType INTEGER, EventType INTEGER, EventTime INTEGER UNSIGNED, ObjectName VARCHAR(64), Name VARCHAR(64), Description TEXT, PRIMARY KEY (ID) );
Use the mdiag -e --xml command in the following format to query the events table.
mdiag -e [-w <starttime>|<endtime>|<eventtypes>|<oidlist>|<eidlist>|<objectlist>] --xml
The table is then displayed with all specified events configured with the RECORDEVENTLIST parameter.
If the command could return a large of data, redirect the output. mdiag -e --xml > outputfile
19.4-F Migrating from Moab 5.4 to Moab 6.0
The ODBC database schema has been updated for Moab 6.0. When updating Moab to version 6.0, the changes below must be applied to the database for database functionality to work. Below are the SQL statements required to update the schema for Moab 6.0.
These changes are only necessary for an ODBC database. An SQLite database does not require an update.
ALTER TABLE Events ADD COLUMN Name VARCHAR(64);
ALTER TABLE Events MODIFY Description TEXT;
CREATE TABLE Nodes (
ID VARCHAR(64),
State VARCHAR(64),
OperatingSystem VARCHAR(64),
ConfiguredProcessors INTEGER UNSIGNED,
AvailableProcessors INTEGER UNSIGNED,
ConfiguredMemory INTEGER UNSIGNED,
AvailableMemory INTEGER UNSIGNED,
Architecture VARCHAR(64),
AvailGres VARCHAR(64),
ConfigGres VARCHAR(64),
AvailClasses VARCHAR(64),
ConfigClasses VARCHAR(64),
ChargeRate DOUBLE,
DynamicPriority DOUBLE,
EnableProfiling INTEGER UNSIGNED,
Features VARCHAR(64),
GMetric VARCHAR(64),
HopCount INTEGER UNSIGNED,
HypervisorType VARCHAR(64),
IsDeleted INTEGER UNSIGNED,
IsDynamic INTEGER UNSIGNED,
JobList VARCHAR(64),
LastUpdateTime INTEGER UNSIGNED,
LoadAvg DOUBLE,
MaxLoad DOUBLE,
MaxJob INTEGER UNSIGNED,
MaxJobPerUser INTEGER UNSIGNED,
MaxProc INTEGER UNSIGNED,
MaxProcPerUser INTEGER UNSIGNED,
OldMessages VARCHAR(64),
NetworkAddress VARCHAR(64),
NodeSubstate VARCHAR(64),
Operations VARCHAR(64),
OSList VARCHAR(64),
Owner VARCHAR(64),
ResOvercommitFactor VARCHAR(64),
Partition VARCHAR(64),
PowerIsEnabled INTEGER UNSIGNED,
PowerPolicy VARCHAR(64),
PowerSelectState VARCHAR(64),
PowerState VARCHAR(64),
Priority INTEGER UNSIGNED,
PriorityFunction VARCHAR(64),
ProcessorSpeed INTEGER UNSIGNED,
ProvisioningData VARCHAR(64),
AvailableDisk INTEGER UNSIGNED,
AvailableSwap INTEGER UNSIGNED,
ConfiguredDisk INTEGER UNSIGNED,
ConfiguredSwap INTEGER UNSIGNED,
ReservationCount INTEGER UNSIGNED,
ReservationList VARCHAR(64),
ResourceManagerList VARCHAR(64),
Size INTEGER UNSIGNED,
Speed DOUBLE,
SpeedWeight DOUBLE,
TotalNodeActiveTime INTEGER UNSIGNED,
LastModifyTime INTEGER UNSIGNED,
TotalTimeTracked INTEGER UNSIGNED,
TotalNodeUpTime INTEGER UNSIGNED,
TaskCount INTEGER UNSIGNED,
VMOSList VARCHAR(64),
PRIMARY KEY (ID)
);
CREATE TABLE Jobs (
ID VARCHAR(64),
SourceRMJobID VARCHAR(64),
DestinationRMJobID VARCHAR(64),
GridJobID VARCHAR(64),
AName VARCHAR(64),
User VARCHAR(64),
Account VARCHAR(64),
Class VARCHAR(64),
QOS VARCHAR(64),
OwnerGroup VARCHAR(64),
JobGroup VARCHAR(64),
State VARCHAR(64),
EState VARCHAR(64),
SubState VARCHAR(64),
UserPriority INTEGER UNSIGNED,
SystemPriority INTEGER UNSIGNED,
CurrentStartPriority INTEGER UNSIGNED,
RunPriority INTEGER UNSIGNED,
PerPartitionPriority TEXT,
SubmitTime INTEGER UNSIGNED,
QueueTime INTEGER UNSIGNED,
StartTime INTEGER UNSIGNED,
CompletionTime INTEGER UNSIGNED,
CompletionCode INTEGER,
UsedWalltime INTEGER UNSIGNED,
RequestedMinWalltime INTEGER UNSIGNED,
RequestedMaxWalltime INTEGER UNSIGNED,
CPULimit INTEGER UNSIGNED,
SuspendTime INTEGER UNSIGNED,
HoldTime INTEGER UNSIGNED,
ProcessorCount INTEGER,
RequestedNodes INTEGER,
ActivePartition VARCHAR(64),
SpecPAL VARCHAR(64),
DestinationRM VARCHAR(64),
SourceRM VARCHAR(64),
Flags TEXT,
MinPreemptTime INTEGER UNSIGNED,
Dependencies TEXT,
RequestedHostList TEXT,
ExcludedHostList TEXT,
MasterHostName VARCHAR(64),
GenericAttributes TEXT,
Holds TEXT,
Cost DOUBLE,
Description TEXT,
Messages TEXT,
NotificationAddress TEXT,
StartCount INTEGER UNSIGNED,
BypassCount INTEGER UNSIGNED,
CommandFile TEXT,
Arguments TEXT,
RMSubmitLanguage TEXT,
StdIn TEXT,
StdOut TEXT,
StdErr TEXT,
RMOutput TEXT,
RMError TEXT,
InitialWorkingDirectory TEXT,
UMask INTEGER UNSIGNED,
RsvStartTime INTEGER UNSIGNED,
BlockReason TEXT,
BlockMsg TEXT,
PSDedicated DOUBLE,
PSUtilized DOUBLE,
PRIMARY KEY (ID)
);
CREATE TABLE Requests (
JobID VARCHAR(64),
RIndex INTEGER UNSIGNED,
AllocNodeList VARCHAR(1024),
AllocPartition VARCHAR(64),
PartitionIndex INTEGER UNSIGNED,
NodeAccessPolicy VARCHAR(64),
PreferredFeatures TEXT,
RequestedApp VARCHAR(64),
RequestedArch VARCHAR(64),
ReqOS VARCHAR(64),
ReqNodeSet VARCHAR(64),
ReqPartition VARCHAR(64),
MinNodeCount INTEGER UNSIGNED,
MinTaskCount INTEGER UNSIGNED,
TaskCount INTEGER UNSIGNED,
TasksPerNode INTEGER UNSIGNED,
DiskPerTask INTEGER UNSIGNED,
MemPerTask INTEGER UNSIGNED,
ProcsPerTask INTEGER UNSIGNED,
SwapPerTask INTEGER UNSIGNED,
NodeDisk INTEGER UNSIGNED,
NodeFeatures TEXT,
NodeMemory INTEGER UNSIGNED,
NodeSwap INTEGER UNSIGNED,
NodeProcs INTEGER UNSIGNED,
GenericResources TEXT,
ConfiguredGenericResources TEXT,
PRIMARY KEY (JobID,RIndex)
);
INSERT INTO ObjectType (Name,ID) VALUES ("Rsv",13);
INSERT INTO ObjectType (Name,ID) VALUES ("RM",14);
INSERT INTO ObjectType (Name,ID) VALUES ("Sched",15);
INSERT INTO ObjectType (Name,ID) VALUES ("SRsv",16);
INSERT INTO ObjectType (Name,ID) VALUES ("Sys",17);
INSERT INTO ObjectType (Name,ID) VALUES ("TNode",18);
INSERT INTO ObjectType (Name,ID) VALUES ("Trig",19);
INSERT INTO ObjectType (Name,ID) VALUES ("User",20);
INSERT INTO ObjectType (Name,ID) VALUES ("CJob",23);
INSERT INTO ObjectType (Name,ID) VALUES ("GRes",30);
INSERT INTO ObjectType (Name,ID) VALUES ("Gmetric",31);
INSERT INTO ObjectType (Name,ID) VALUES ("Stats",39);
INSERT INTO ObjectType (Name,ID) VALUES ("TJob",42);
INSERT INTO ObjectType (Name,ID) VALUES ("Paction",43);
INSERT INTO ObjectType (Name,ID) VALUES ("VM",45);
INSERT INTO ObjectType (Name,ID) VALUES ("JGroup",48);
INSERT INTO EventType (Name,ID) VALUES ("TRIGTHRESHOLD",41);
INSERT INTO EventType (Name,ID) VALUES ("VMCREATE",42);
INSERT INTO EventType (Name,ID) VALUES ("VMDESTROY",43);
INSERT INTO EventType (Name,ID) VALUES ("VMMIGRATE",44);
INSERT INTO EventType (Name,ID) VALUES ("VMPOWERON",45);
INSERT INTO EventType (Name,ID) VALUES ("VMPOWEROFF",46);
INSERT INTO EventType (Name,ID) VALUES ("NODEMODIFY",47);
INSERT INTO EventType (Name,ID) VALUES ("NODEPOWEROFF",48);
INSERT INTO EventType (Name,ID) VALUES ("NODEPOWERON",49);
INSERT INTO EventType (Name,ID) VALUES ("NODEPROVISION",50);
INSERT INTO EventType (Name,ID) VALUES ("ALLSCHEDCOMMAND",51);
INSERT INTO EventType (Name,ID) VALUES ("AMCANCEL",52);
INSERT INTO EventType (Name,ID) VALUES ("AMDEBIT",53);
INSERT INTO EventType (Name,ID) VALUES ("AMQUOTE",54);
INSERT INTO EventType (Name,ID) VALUES ("AMRESERVE",55);
INSERT INTO EventType (Name,ID) VALUES ("RMPOLLEND",56);
INSERT INTO EventType (Name,ID) VALUES ("RMPOLLSTART",57);
INSERT INTO EventType (Name,ID) VALUES ("SCHEDCYCLEEND",58);
INSERT INTO EventType (Name,ID) VALUES ("SCHEDCYCLESTART",59);
INSERT INTO EventType (Name,ID) VALUES ("JOBCHECKPOINT",60);
ALTER TABLE GeneralStats ADD COLUMN TotalConfiguredProcCount INTEGER;