FTS 3.2.22

Posted by FTS Team on May 7, 2014 |

  • UDT support, configuring FTS3 to use GridFTP/UDT instead of GridFTP/TCP (will fallback automatically to TCP if UDT fails )

  • fix for parsing MySql? Db connection string when contains IPv6 address

  • global transfer timeout can now be set, along with complimentary seconds per megabyte (fts-config-set CLI)

  • improved error messages, clearly state the source of failure and the phase (SOURCE, DESTINATION, etc)

  • introduce max limits for number of active of a given source or destination endpoint (if set will vary between 2-MAX)

  • apply bandwidth restrictions to individual endpoints served as source or destination of a given link

  • persistently drain hosts to survive restarts, draining state is now stored into the db

  • optimize MySql? insertions by introducing bulk insert statements

  • double precision problem fixed when user-specified filesize was provided

  • increase number of default pooled threads to 25 so as to avoid gsoap requests backlog

  • transfer multi-hop

  • ATLAS stage-in only feature

  • specify/submit nostreams, timeout, buf size at submission time at the job level

  • activity VO shares

  • fixed delegation issues releated to voms roles

  • introduce bulk cancellations via a file

  • lcgadmin role is now default in fts3config file

  • new client fts-transfer-snapshot to retrieve internal info of FTS3 activity


         This command returns a snapshot of FTS3 activity per vo and link (number of active

         transfers, queued files, average throughput, etc.).

Usage: fts-transfer-snapshot [options]

Allowed options:

  -h [ --help ]              Print this help text and exit.
  -q [ --quite ]             Quiet operation.
  -v [ --verbose ]         Be more verbose.
  -s [ --service ] arg     Use the transfer service at the specified URL.
  -V [ --version ]          Print the version number and exit.

  --source arg             Specify source site name.
  --destination arg      Specify destination site name.
  --vo arg                   Specify VO name.

  • added time range filter in the monitoring web-app for the optimizer evolution

  • infosys publisher and monitoring using messaging now exist as separate packages and can be installed optionally

Important notes:

  • For sites running on ORACLE

               *scratch the database and re-install the schema from the relevant package

  • For sites running on MySql?

               *If you can drop the schema, drop and re-install

               *If not, then :

drop table t_server_config;
CREATE TABLE t_server_config (retry INTEGER DEFAULT 0,max_time_queue INTEGER DEFAULT 0,global_timeout INTEGER DEFAULT 0,sec_per_mb INTEGER DEFAULT 0);
drop table t_hosts;
CREATE TABLE t_hosts (hostname VARCHAR(64) NOT NULL,service_name VARCHAR(64) NOT NULL,beat TIMESTAMP NULL DEFAULT NULL,drain INTEGER DEFAULT 0, CONSTRAINT t_hosts_pk PRIMARY KEY (hostname, service_name));
drop table t_activity_share_config;
CREATE TABLE t_activity_share_config (vo VARCHAR(100) NOT NULL PRIMARY KEY,activity_share VARCHAR(255) NOT NULL,active VARCHAR(3) check (active in ('on', 'off')));
drop table t_optimize;
CREATE TABLE t_optimize(auto_number INTEGER AUTO_INCREMENT,file_id INTEGER NOT NULL,source_se VARCHAR(150), dest_se VARCHAR(150), nostreams INTEGER DEFAULT NULL,timeout INTEGER DEFAULT NULL, active INTEGER DEFAULT NULL, throughput FLOAT DEFAULT NULL, buffer INTEGER DEFAULT NULL, filesize DOUBLE DEFAULT NULL, datetime TIMESTAMP NULL DEFAULT NULL, udt VARCHAR(3) CHECK (udt in ('on', 'off')), CONSTRAINT t_optimize_pk PRIMARY KEY (auto_number) );
This will take long, be patient
ALTER TABLE t_file MODIFY file_metadata VARCHAR(1024);
ALTER TABLE t_file_backup MODIFY file_metadata VARCHAR(1024);
ALTER TABLE t_job MODIFY job_metadata VARCHAR(1024);
ALTER TABLE t_job_backup MODIFY job_metadata VARCHAR(1024);
ALTER TABLE t_file ADD activity VARCHAR(255) DEFAULT "default", ADD COLUMN transferred DOUBLE DEFAULT 0;
ALTER TABLE t_file_backup ADD activity VARCHAR(255) DEFAULT "default", ADD COLUMN transferred DOUBLE DEFAULT 0;
ALTER TABLE t_file DROP INDEX file_tr_host;
ALTER TABLE t_file ADD INDEX t_file_activity(activity), ADD INDEX file_tr_host(transferHost, file_state);
ALTER TABLE t_job ADD INDEX t_job_source_se(source_se),  ADD INDEX t_job_dest_se(dest_se);
  • fts-client
  • fts-libs
  • fts-devel
  • fts-python
  • fts-server
  • fts-monitoring
  • fts-mysql
  • fts-infosys
  • fts-msg